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Basis of the report 

With regard to the elements of the international application (Replacement sheets which have been furnished to 
the receiving Office in response to an invitation under Article 14 are referred to in this report as "originally filed" 
and are not annexed to this report since they do not contain amendments (Rules 70. 16 and 70. 17)): 
Description, pages: 

1-29 as originally filed 

Claims, No.: 

1-31 as originally filed 

Drawings, sheets: 

1/8-8/8 as originally filed 



2. With regard to the language, all the elements marked above were available or furnished to this Authority in the 
language in which the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language: , which is: 

□ the language of a translation furnished for the purposes of the international search (under Rule 23.1 (b)). 

□ the language of publication of the international application (under Rule 48.3(b)). 

□ the language of a translation furnished for the purposes of international preliminary examination (under Rule 
55.2 and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the 
international preliminary examination was carried out on the basis of the sequence listing: 

□ contained in the international application in written form. 

□ filed together with the international application in computer readable form. 

□ furnished subsequently to this Authority in written form. 

□ furnished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in 
the international application as filed has been furnished. 

□ The statement that the information recorded in computer readable form is identical to the written sequence 
listing has been furnished. 

4. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, IMos.: 
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□ the drawings, sheets: 

5. □ This report has been established as if (some of) the amendments had not been made, since they have been 
considered to go beyond the disclosure as filed (Rule 70.2(c)): 

(Any replacement sheet containing such amendments must be referred to under item 1 and annexed to this 
report.) 



6. Additional observations, if necessary: 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1. Statement 

Novelty (N) Yes: Claims 1-31 

No: Claims 

Inventive step (IS) Yes: Claims 2-17;19-29 

No: Claims 1,18,30-31 

Industrial applicability (I A) Yes: Claims 1-31 

No: Claims 



2. Citations and explanations 
see separate sheet 

VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 
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INTERNATIONAL PRELIMINARY International application No. PCT/GB00/01 71 5 
EXAMINATION REPORT - SEPARATE SHEET 

To Section V: 

1 . Claim 1 does not meet the requirement of Article 33(3) PCT for the following 
reason: 

Maintaining performance in the presence of interfering signals is a well known 
problem associated with speech recognizers. In the prior art, adaptive filters are 
known to tackle the above problem. 

Document D1= US-A-4630304 (introduced by the International Preliminary 
Examining Authority; a copy is enclosed), for example, discloses an apparatus for 
cancellation of quasi-stationary interfering signals whereby said apparatus 
includes (see col. 3, I. 36-61; fig. 1): 

- means for receiving an acoustic signal; 

- means for generating an estimated value of a magnitudes spectrum of said 
quasi-stationary interfering signals (see col. 3, 53-57); and 

- means for subtracting said estimated value from said received acoustic signal to 
produce a representation of a wanted speech magnitudes spectrum (see col. 3, I. 
58-61). 

In an attempt to overcome the problem of non-stationary interfering signals, it 
would readily occur to a skilled person to employ the above apparatus for 
cancellation of interfering signals. As a result, the subject-matter of claim 1 would 
be obvious to the skilled person and, hence, claim 1 does not involve an inventive 
step. 

2. Claim 18 claims a method of cancellation of one or more non-stationary interfering 
signals for speech recognition. Since method claim 18 corresponds to apparatus 
claim 1 , the objection of lack of inventive step raised against claim 1 applies to 
claim 18 as well. Moreover, claims 30-31 as far as dependent upon claim 1 are 
not inventive. 

3. Claims 2-17 and 19-29 are new and appear to involve an inventive step. 
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To Section VII: 

4. Document D1 discloses background art which is not identified in the description; 
furthermore, the relevant prior art disclosed therein is not discussed (Rule 
5.1 (a) (ii) PCT). 
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(54) Title: CANCELLATION OF NON-STATIONARY INTERFERING SIGNALS FOR SPEECH RECOGNITION 
(57) Abstract 



System for cancellation of 
non-stationary interfering signals, 
particularly for use for mitigating 
effects of such interferers produced 
by in-car entertainment (ECAD) 
devices for speech recognition 
applications. The system spectrally 
analyses signals output by the ECAD 
before and after they are passed 
through an in-car acoustic channel. 
A model of the acoustic channel 
is built by the system's algorithm. 
For speech recognition the model is 
spectrally subtracted from a signal 
received at a microphone in order to 
recover a wanted speech signal. The 
acoustic channel model is built by 
estimating frequency domain acoustic 
transfer functions between each 
loudspeaker used by the ECAD and 
the microphone. 
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Cancellation of Non- Stationary Interfering Signals 
for Speech Recognition 

This invention relates to apparatus and method for 
cancellation of non- stationary interfering signals. In 
5 particular, the invention relates to cancellation of such 
signals for the purpose of recovering a wanted speech signal 
for use by a speech recognition application. The invention 
is especially suitable for use in an automobile where in-car 
devices produce interfering signals during the speech 

10 recognition process. 

A problem associated with speech recognition is that of 
maintaining performance in the presence of interfering 
signals so that the speech recognition process continues to 
function satisfactorily even in the presence of background 

15 noise. Known systems have been directed towards mitigating 
effects of quasi -stationary noise such as telephone channel 
noise or car noise. Proposed solutions to quasi-stationary 
noise interference include spectral subtraction, Weiner 
filtering and parallel model combination, each of which work 

2 0 in the spectral domain. 

There are, however, other sources of interference in 
acoustic environments which may degenerate performance of 
speech recognition applications. In the example of an 

automobile environment, in addition to engine noise, another 

25 source of potentially interfering non- stationary acoustic 
signals includes sound generated by electronic devices 
operating in the car. Examples of such devices include in- 



WO 00/68936 




PCT/GB00/01715 



2 



car entertainment accessories such as radios, compact disc 
players and tape players and also other types of devices 
which may emit sonic signals, e.g. telephone ringing or 
navigation system warning tones. In this specification, 
5 electronic devices capable of emitting acoustic signals and 
operating in a vehicle are generically referred to as 
"Electronic in- car Acoustic Devices" (ECAD) . 

Sound generated by ECAD could be present when a user 
wishes to control a device using a voice command. For 

10 example, a radio may be playing in a car when the user wants 
to use voice control of a navigation system or the radio 
itself. In this case, the original interfering signal 
produced by the radio is assumed to be known and accessible 
but has passed through an unknown acoustic path between the 

15 radio's loudspeakers and the speech recognition system's 
microphone. The acoustic path may be determined by the 
position of the loudspeakers and the microphone inside the 
car as well as other factors, such as the number of passen- 
gers and the presence of luggage inside the car. 

2 0 Known systems which attempt to overcome the problem of 

non- stationary interferers have been based on time domain 
adaptive filters. However, although adaptive filtering may 
produce satisfactory results, this approach suffers from a 
number of disadvantages. Such disadvantages include high 

25 computational requirements and slow convergence of adaptive 
filtering algorithms. Simple forms of adaptive filtering 
may require order 3N computations per sample. Such high 
computational requirements can mean that complex hardware 
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may be required in order to perform the necessary filtering, 
thereby increasing costs of devices incorporating such 
technology to the consumer. 

According to a first aspect of the present invention, 
5 there is provided apparatus for cancellation of one or more 
non- stationary interfering signals for speech recognition, 
said apparatus comprising: 

means for receiving an acoustic signal; 

means for generating an estimated value of a magnitude 
10 spectrum of said non- stationary interfering signals; and 

means for subtracting said estimated value from said 
received acoustic signal to produce a representation of a 
wanted speech magnitude spectrum. 

Preferably, said means for generating estimated value 
15 includes processing means configured to estimate a transfer 
function for an acoustic channel between each source of said 
non- stationary interfering signals and said means for 
receiving an acoustic signal . 

Preferably, said processing means is configured to 
20 estimate transfer functions for non- stationary interfering 
signals produced by left and right stereo channel trans- 
missions . 

Preferably, said estimation of said transfer functions 
is achieved by said processing means executing an iterative 
25 algorithm on a frame -by -frame basis, the frames being 
constituted by successive time periods. 

Preferably, said processing means is configured to 
estimate magnitudes of said left and right channel interfer- 
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ence signals, 

said magnitude of left channel interference signal 
estimated by subtracting said right channel interference 
signal magnitude estimated during previous said iteration 
5 from said acoustic signal received at current said iter- 
ation; and 

said magnitude of right channel interference signal is 
estimated by subtracting said left channel interference 
signal magnitude estimated during previous said iteration 
10 from said acoustic signal received at current said iter- 
ation. 

Preferably, said transfer function estimate for said 
right stereo acoustic channel is determined by dividing said 
right channel interference magnitude estimate by said 
15 interfering signal transmitted from said right acoustic 
stereo channel ; and 

said transfer function estimate for said left stereo 
acoustic channel is determined by dividing said left channel 
interference magnitude estimate by said interfering signal 
20 transmitted from said left acoustic stereo channel. 

Preferably, said right acoustic channel transfer 
function estimation is performed for a said iteration only 
if a ratio of total energy of said right acoustic stereo 
channel interfering signal over total energy of said left 
2 5 acoustic stereo interfering channel exceeds a predetermined 
threshold value; and 

said left acoustic channel transfer function estimation 
is performed for a said iteration only if a ratio of total 
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energy of said left acoustic stereo channel interfering 
signal over total energy of said right acoustic stereo 
channel interfering signal exceeds a predetermined threshold 
value . 

5 Preferably, said ratio and threshold comparisons are 

applied to individual frequency components in spectra of 
said signals. 

Preferably, said left and right stereo acoustic channel 
transfer functions are multiplied by (l-|Tj(k)|) where ti (k) 
10 is coherence of said left and right interfering signals at 
a frequency index k. 

Preferably, said transfer function estimate for said 
right stereo acoustic channel is obtained using an express- 
ion: 

15 and said transfer functions estimate for said left stereo 
acoustic channel is obtained using an expression: 

0 m- y <*> - H " lk) - L " ik) -H (k) 



wherein R M (k)=H CR (k) .C(k) , with C (k) being a common component 
of said left and right stereo channel signals and H CR (k) is 
a transfer function between common said left and right 
20 stereo channel transmissions, and said right stereo channel 
and L" (k) =L (k) -H CL (k) . C (k) , where H CL (k) is a transfer 
function between common said left and right stereo channel 
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transmissions and said left stereo channel signal. 

Preferably, wherein said processing means further 
comprises means for smoothing said estimated transfer 
functions in time domain. 
5 Preferably, wherein said means for smoothing in time 

domain comprises a first order recursive filter. 

Preferably, said processing means further comprises 
means for smoothing said estimated transfer functions in 
frequency domain. 
10 Preferably, said means for smoothing in frequency 

domain comprises a Finite Impulse Response filter. 

Preferably, said processing means includes means for 
performing a Fourier Transform. 

Preferably, said non- stationary interfering signals are 
15 produced by an electronic acoustic device operating in a 
vehicle . 

Preferably, said means for receiving an acoustic signal 
comprises a microphone. 

According to a second aspect of the present invention 
2 0 there is provided a method of cancellation of one or more 
non-stationary interfering signals for speech recognition, 
said method comprising steps of: 

receiving an acoustic signal; 

generating an estimated value for a magnitude spectrum 
25 of said non- stationary interfering signal; and 

subtracting said estimated value from said received 
acoustic signal to produce a representation of a wanted 
speech magnitude spectrum. 
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Preferably, said step of generating an estimated value 
comprises estimating a transfer function for an acoustic 
channel between each source of said non- stationary interfer- 
ing signals and said means for receiving an acoustic signal . 
5 Preferably, said transfer functions are estimated for 

non-stationary interfering signals produced by left and 
right stereo channel transmissions. 

Preferably, said step of generating an estimated value 
is executed iteratively on a frame -by- frame basis. 
10 Preferably, said step of estimating a transfer function 

includes : 

estimating a magnitude of said left channel interfer- 
ence signal by subtracting said right channel interference 
signal magnitude estimated during previous said iteration 
15 from said acoustic signal received at current said iter- 
ations; and 

estimating magnitude of said right channel interference 
signal by substracting said left channel interference signal 
magnitude estimated during previous said iteration from said 
2 0 acoustic signal received at current said iteration. 

The method may further comprise steps of: 

dividing said right channel interference magnitude 
estimate by said interfering signal transmitted from said 
right acoustic stereo channel; and 
2 5 dividing said left channel interference magnitude 

estimated by said interfering signal transmitted from said 
left acoustic stereo channel. 

Preferably, said step of estimating right acoustic 



WO 00/68936 




PCT/GB00/01715 



8 



channel transfer function is performed for a said iteration 
only if a ratio of total energy of said right acoustic 
stereo channel interfering signal over total energy of said 
left acoustic stereo channel interfering signal exceeds a 
5 predetermined threshold value; and 

said step of estimating left acoustic channel transfer 
function estimate is performed for a said iteration only if 
a ratio of total energy of said left acoustic stereo channel 
interfering signal over total energy of said right acoustic 
10 stereo channel interfering signal exceeds a predetermined 
threshold value . 

Preferably, said ratio and threshold comparisons are 
applied to individual frequency components in spectra of 
said signals. 

15 Preferably, said left and right stereo acoustic channel 

transfer functions are multiplied by (l-|i)(k)|) where tj (k) 
is coherence of said left and right interfering signals at 
a frequency index k. 

Preferably, said transfer function estimate for said 

2 0 right stereo acoustic channel is obtained using an express- 
ion: 

Preferably, this aspect may be comprising a step of 
smoothing said estimated transfer functions in time domain. 

Preferably, this aspect may be further comprising a 
25 step of smoothing said estimated transfer functions in 
frequency domain. 

According to a third aspect of the present invention, 
there is provided a speech recognition system including 
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apparatus according to the first aspect of the invention. 
According to a fourth aspect of the present invention, there 
is provided an electronic acoustic device including appar- 
atus according to the first aspect of the invention. 
5 The present invention is a frequency domain (rather 

than time domain as used in known systems) technique 
solution which is preferably based on channel identification 
followed by spectral subtraction. Embodiments of the 
present application's system can substantially improve 
10 performance of a speech recognition system when non-station- 
ary interferers are present whilst having the advantage of 
lower computational requirement than known systems. 

Embodiments of the present application's system provide 
levels of non- stationary interferer cancellation sufficient 
15 to substantially improve the performance of a speech 
recognition system, typically about 10 decibels of cancella- 
tion is possible in the case where loud background music is 
being output by ECAD . Such levels of cancellation may not 
be satisfactory to a human listener, however. For the 

20 purposes of speech recognition applications, such levels of 
cancellation will substantially improve the system's 
performance. A human listener is sensitive to levels of 
interference 40 decibels below the level of wanted signal, 
whilst known speech recognition systems can operate well 
25 with a 15 decibel signal-to-noise ratio. 

The interfering signal output by an ECAD such as a 
radio may be a mono or stereo transmission, typically being 
output from two loudspeakers located at separate locations 
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within an automobile. For the purposes of the description, 
it is generally assumed that a phase of the interferer 
signal is not required at the speech recognition system, as 
recognition feature sets such as cepstra do not normally 
5 contain phase information. 

The invention may be performed in various ways and, by 
way of example only, a specific embodiment thereof will now 
be described, reference being made to the accompanying 
drawings, in which: 
10 Figure 1 illustrates schematically an example of an 

automobile environment having an ECAD where a speech 
recognition system is used to control an in-car device; 

Figure 2 illustrates a flow diagram representing steps 
which may be used to estimate transfer functions represent - 
15 ing a model of an in-car acoustic channel; 

Figure 3 illustrates schematically components which may 
be used to implement a refinement of the algorithm in Figure 
2; 

Figure 4 illustrates a block diagram representing a 
2 0 specific embodiment of the present invention; and 

Figures 5 to 8 illustrate examples of microphone 
signals obtained during experimental use of the present 
invention. 

Figure 1 illustrates schematically a simple situation 
25 in which stereo ECAD signals are transmitted from separate 
loudspeakers. Left stereo signal Mjo)) is transmitted from 
left loudspeaker 101 and right stereo signal R(j<o) is 
transmitted from right stereo speaker 102. 
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Loudspeakers 101 and 102 are typically located in 
panelling on driver and passenger's doors. Further loud- 
speakers may also be fitted in the vehicle, for example they 
may be located in a boot compartment at the rear of the car. 
5 It will be appreciated by those skilled in the art that the 
specific embodiment described herein intended for use with 
two loudspeakers could be modified to function with differ- 
ent numbers of loudspeakers, which may or may not be 
configured to generate signals which correlate with signals 
D being output from other loudspeakers present in the car. 

Figure 1 also includes a microphone 103 which is 
preferably connected to an in-car electronic device such as 
the radio for the purpose of receiving acoustic signals 
which may be used by a speech recognition system for 
5 controlling the device. 

A user's voice command which may be processed by the 
speech recognition system in order to control the electronic 
device is represented by wanted speech signal S(jo>)104. 

A spectrum of the acoustic signal received at the 
0 microphone, denoted by Y (<«>), comprises components including 
a combination of the wanted speech S(jco) and the signals 
produced by the loudspeaker having passed through an 
acoustic channel defined by the in-car environment. 

Perfect cancellation of the unwanted ECAD stereo 
5 signals L(jo) and R(j*>) could in principle be achieved given 
knowledge of acoustic transfer functions H AR (jo>) for the 
acoustic path between the right loudspeaker 102 and micro- 
phone 103 and acoustic transfer function H^fjo) for the 
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acoustic path between the left loudspeaker 101 and micro- 
phone 103. If the transfer functions H^fjo) and H AR (ja>) 
were known, it would be possible to retrieve a signal 
corresponding to the wanted speech command spoken by the 
5 user by subtracting the left stereo source signal L(jo>) 
transferred by H^fjw) and the right source signal R(j<o) 
transferred by H^fju) from the signal Y(j<o) received at 
microphone mono 103. However, in practice although source 
signals Mju) and R(jo>) may be accessible from the radio 

10 which produced them, the acoustic transfer functions H AR (jo) 
and H AL (jd)) can only be estimated. 

A simple approach to the estimation of the acoustic 
transfer function is to find the long term ratio of micro- 
phone signal spectrum to each of the source stereo signals. 

15 Equations herein below describe this process for the right 
acoustic channel. Those skilled in the art will understand 
that a similar set of equations can be derived for the left 
acoustic channel. A basic transfer function for the 

right acoustic channel may be written as follows: 



A spectrum of the signal Y(ju) received at the micro- 
phone signal may be written as: 

Y(jo>) ^Hj^Uv) -R(jo>) +H AL (jc>) .L(ja>) +S(ja>) 




20 



Equation (1) 



Equation (2) 
Substituting for Y(j(o) in equation (1) gives: 
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Equation (3) 

The following conclusions may be drawn from equa- 
tion(3) : 

o In the case of a mono transmission being output through 
5 loudspeakers 101 and 102 whilst the user is saying a voice 
command, signals L(ju) and R(j©) are completely correlated 
with each other whilst being completed uncorrelated with 
S(jo)). In this case, individual left and right channel 
transfer functions cannot be uniquely determined, but a 

10 composite estimate which contains terms due to both left and 
right channels can be obtained. This is sufficient for 
practical cancellation of the mono ECAD signal output 
through the two loudspeakers received at the microphone, 
o if L(jd)) and R(jd>) and S(jd>) are all uncorrelated, a 

15 correct estimate of the channel response will be obtained 
because second and third terms in equation (3) will normally 
have long term averages of 0. 

o if L(j(d) and R(jw) are partially correlated, left and 
right acoustic channels cannot be unambiguously estimated. 

20 However, if L(jw) and R(ja>) occupy different spectral 
regions or if corresponding time domain signals 1 (t) and 
r(t) have periods where one has low energy whilst the other 
has high energy, it may be still possible to make useful 
estimates of left and right channels for purposes of 

25 cancellation. 

The frequency domain estimation of the right acoustic 
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channel response given by equation (3) , and a corresponding 
equation for the left acoustic channel transfer function, 
H^Cjo), may be used to obtain an estimate of the magnitude 
of the wanted speech spectrum S(j<o). An estimate of the 
5 wanted speech magnitude spectrum may be obtained by sub- 
tracting the estimates of the left and right acoustic 
channels of the ECAD signals from the acoustic signal Y(jo>) 
received at the microphone: 

S 2 (co) =Y 2 (co) -iPju .R 2 (co) -H 2 ^ . L 2 (co) 

Equation (4) 

10 An estimate of the acoustic channel power transfer 

function for the right acoustic channel, derived by squaring 
equation (3) may be as follows: 

Equation (5) 

A corresponding estimate of the acoustic channel power 
15 transfer function for the left acoustic channel can also be 
derived by those skilled in the art. 

Using an iterative approach, coupled with time and 
frequency dimension smoothing of the estimates of the 
channel response may be used to overcome problems caused by 
2 0 left and right signal correlation described herein above. 
Another problem which may need to be addressed arises 
because phase information in the channel response may be 
ignored, as the phase of the interferer is not normally 
required at the speech recognition system. As noted above, 
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cancellation for the purpose of speech recognition only 
requires an estimate of the magnitude of the speech spectrum 
because Mel Frequency Cepstral Co-efficient (MFCC) feature 
vector used by the speech recognition system in the pre- 
5 f erred embodiment is based on magnitude spectra. The MFCC 
may be obtained by subjecting the speech spectrum in the 
frequency domain to a fast fourier transform in order to 
obtain its power in various frequency slots. The value of 
the power in the frequency domain is then passed through a 

10 log function and then a cosine transform to obtain the 
cepstrum in which the elements are orthogonal . 

Normally, the phase characteristic encodes a frequency 
dependent delay spread associated with the acoustic transfer 
function. In a car typically the minimum delay is about 

15 3ms. The delay spread may be compensated when making the 
channel estimate using equation (5) . However, this compen- 
sation may be unnecessary if the spectral evaluation is done 
using a fast fourier transformer with block length much 
greater than the channel delay. 

2 0 A practical form of the cancellation of non-stationary 

interferer signals such as those produced by ECAD may 
therefore be achieved using an algorithm 200 as illustrated 
by steps in Figure 2 of the accompanying drawings. In the 
preferred embodiment, the steps 201 to 205 are repeated once 

25 for each single frame (i.e a signal received at the micro- 
phone in a fixed period of time) , however, initialisation 
steps 201 and 202 may only be performed for a first frame. 
At step 201, estimates of magnitudes of the left and right 
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channel transfer functions, H^dT*)) and H^fJw) are 
initialised (set to zero) : 

H 2 AR (a>)=H 2 AL (co)=o 

At step 202, estimates of magnitude of left and right 
channel interference, C L and C R/ are initialised: 

5 At step 203, new estimates of magnitudes of the left 

and right interference signals at the microphone are 
calculated. This is achieved for the left microphone signal 
by subtracting the channel estimate of the magnitude of the 
right channel (calculated during the algorithm iteration for 
10 the immediately previous frame) from the microphone signal 
received at the current iteration (n) . For the right 
interference channel, the magnitude estimate for the left 
channel derived during the previous iteration (n-1) is 
subtracted from the microphone signal : 

cL n (»)*T£<v) -cV a -j (») 

15 (Equation 6) 

cln(co)^ <»)-e* L . n - 1 (*>> 

(Equation 7) 

At step 204, rough estimates of the left and right 
transfer functions, H AL (jo>) and H AR (jw), are made. This is 
achieved for the left channel transfer function by dividing 
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the estimated left interference signal calculated at step 
203 by the signal transmitted from the left stereo acoustic 
channel. For the right transfer function, the right channel 
interference signal estimate calculated at step 203 is 
5 divided by the signal transmitted from the right acoustic 
stereo channel : 



~ , . Ct rn (a>) 



(Equation 8) 



(Equation 9) 



Substituting equations (6) and (7) into the terms for 
10 the estimated interference signals in equations (8) and (9) , 
respectively, gives expressions used to provide rough 
estimates of the left and right channel transfer func- 
tions : 

H ALn(°>/ — 2 



(<0> 
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At step 205 the rough estimates of the channel transfer 
functions obtained at step 204 may be smoothed, preferably 
both in the time and frequency domains. Time smoothing is 
preferably achieved with a first order recursive filter 
5 using a time constant of several hundred milliseconds. For 
example, time smoothing for the right channel may be as 
follows (a similar equation may also be obtained) : 

Frequency smoothing is preferably achieved using a 
10 Finite Impulse Response filter (represented by f (o>) in an 
equation herein below) with a triangular impulse response 
covering about 300 Hertz. Frequency smoothing for the right 
channel may be as follows (a similar expression for the left 
channel may also be obtained) : 

15 The cancellation algorithm 200 described in steps 201 

to 2 05 herein above may be refined by means of the four ways 
described herein below in order to attempt to deal with 
problems highlighted by equation (3) concerning correlation 
of left and right channel signals : 

20 1. Updating of the recursive filter providing the smoothed 
channel estimate can be inhibited unless energy of one 
channel greatly exceeds energy of the other channel . This 
is preferably achieved by updating the left or right channel 
response only when it is assumed that only left or right 

25 channel, respectively, is active. Thus, a new right 
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acoustic channel transfer function would be estimated at 
step 204 if a ratio of the total energy of the signal 
transmitted from the right acoustic stereo channel by the 
total energy of the signal transmitted from the left stereo 
5 acoustic channel exceeds a predetermined threshold value, 
otherwise the estimate calculated for the transfer function 
during the previous frame iteration is used. A correspon- 
ding estimation would also be performed for the left 
transfer function. 
10 Using E L to represent the total energy in the n th frame 

of the left stereo acoustic channel and E R represent the 
total energy in the n th frame of the right stereo acoustic 
channel. Thus, the channel response estimation algorithm 
for the right channel is: 

15 

H D ^XU^l if ^Threshold 

otherwise use previous estimate (H AR ^ n _ 1 )if E R /E L < Thr- 
eshold. 

The channel response estimation algorithm for the left 
channel is: 

20 

if ^Threshold , 
a 1 "* 1 L(jix>) E R 

otherwise use previous estimate (H^ fI1 _i) if e r/ e l < 
Threshold. 
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Normally, when considering the right channel, when the 
threshold is exceeded, Y(j<o) should consist mainly of terms 
due to the right channel and the wanted speech signal . 
Y(j(i>) should contain very little energy due to the left 
5 channel if the threshold is set at high value. The reverse 
normally holds when considering the left channel. Time and 
domain smoothing substantially as described at step 205 
would also be used. 

2. Updating of recursively smoothed channel estimate at 
10 particular frequencies can be inhibited unless energy at 
that frequency in one channel greatly exceeds the energy at 
that frequency in the other channel. This may be achieved 
by estimating new values for the left and/or right acoustic 
channel transfer functions when a ratio of the total 
15 energies of the left and right stereo acoustic signals 
exceeds a given threshold at individual frequency components 
in the spectrum. Preferably, the threshold may apply to 
frequencies comprising a harmonic number in the Discreet 
Fourier Transforms of the signals. 
20 Using a similar terminology to that in 1. herein above, 

the channel response estimation algorithm for the right 
channel is: 

(jc) = y(Jc) if E \^\ R ^Threshold 
*AR,n^> R{k) E(k) L 

Otherwise use estimate at previous iteration (H^n-i) 
if E(k) R /E(k) L < Threshold. 



WO 00/68936 



21 



PCT/GB00/0I715 



The channel response estimation algorithm for the left 
channel is: 

otherwise use the estimate calculated at the previous 
iteration (H^n-i) if E(k) L /E(k) R < Threshold. 
5 In this definition, the index k refers to the harmonic 

number in the DFTs of the signals. For example, E(k) R is the 
energy of the kth harmonic in the DFT of the right stereo 
source signal. This algorithm should ensure that the 
acoustic channel responses are only updated at those fre- 
10 quencies and at those time at which the signal at the 
microphone consists mainly of either left or right channel. 
3. Evaluate coherence function between the left and right 
channel signals and use inverse magnitude of the coherence 
at each frequency as a weighting on the amount by which 
15 estimates of the channel responses are updated at that 
frequency. The coherence function provides a measure of 
correlation over a period of time of phases of two different 
signals measured at a particular frequency. The coherence 
function may be used in various ways, normally based on the 
2 0 idea that the update of the acoustic channel responsible 
will be decreased if the left and right stereo channels are 
phase -correlated at a particular frequency. If the coher- 
ence approaches unity, the signals are correlated, but only 
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at the specified frequency. Thus, the channel response 
estimates for the right channel may be derived from the 
following algorithm (a corresponding method for the transfer 
function for the left channel may also be derived) : 



5 where r\ (k) is the coherence of the left and right stereo 
source signal at frequency index k. 

„ fk ) JL(k).RUk) \ 

where the expectation is over time. 
4 . Extract those components of the left and right ECAD 
source signals which are uncorrelated (orthogonal) and use 

10 them to make estimates of the left and right channel 
responses. In this approach, a common component C(k) in the 
left and right ECAD sources is removed by adaptive filtering 
to yield an orthogonal pair of signals, L 1 1 (k) and R 1 1 (k) : 
R (k) =R" (k) +H CR (k) . C (k) 

15 L (k) =L» (k) +H CL (K) . c (k) 

wherein H CL (k) is the transfer function between the 
common (left and right stereo signals combined, which may be 
fixed in a recording studio) ECAD signal source and the left 
ECAD signal source and H CR (k) is the transfer function 

20 between the common ECAD source, signal and the right ECAD 
source . 
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The orthogonal ised signals are used to make the 
acoustic channel response estimates. For the right stereo 
channel transfer function the following expression may be 
used (a corresponding expression for the left stereo channel 
5 transfer function may also be obtained) : 

0 tk\- Y{k) - H ** iK) ' <*"<*> -cik)) h H^ik) . USik) ^H^ik) .c(k)) ^ S (k) 

** R"ik) R"{k) R"(k) R»ik) 



Most of the terms are long term uncorrelated so we get 



** R"(k) R"(k) ** 



the true acoustic channel response. 

Thus, the right stereo acoustic channel function, 
H^Oc), may be obtained by dividing the signal received at 

10 the microphone by R' ' (k) . 

Figure 3 of the accompanying drawings illustrates 
schematically an example of components which may be used to 
form L 1 ' (j<i>) and R 1 1 (jo>) . The components include two 
adaptive filters, 303 and 304, either implemented in the 

15 frequency domain, or preferably, the time domain. The 
coefficients of each FIR adaptive filter are adjusted using 
LMS or similar, to minimise the total energy in r f 1 (n) and 
1' 1 (n) , respectively, i.e. operate filters in standard 
system identification mode as in echo cancelling etc. 

20 The right stereo ECAD signal r(n) 301 is fed into 
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adaptive filter 303 and a combiner 305. The left stereo 
ECAD signal 1 (n) 302 is fed into adaptive filter 304 and a 
combiner 306. The output of adaptive filter 303 is also fed 
into combiner 306. The output of adaptive filter 304 is 
5 also fed into combiner 305. The output of combiner 305 may 
be fed back via an adaption control path into adaptive 
filter 304. The output of mixer 306 may be fed back into 
adaptive filter 3 03 via an adaption control path. The 
output of combiner 3 05 comprises the orthogonal right stereo 
10 signal r' 1 (n) 307. The output of combiner 306 comprises the 
left stereo orthogonal signal 1 1 1 (n) 308. 

Figure 4 of the accompanying drawings illustrates a 
block diagram representing a specific embodiment of the 
present invention. Processing components of Fig. 4 may be 
15 electronic processors fitted integrally to the in-car device 
where the speech recognition system is located or, alterna- 
tively, may be a stand alone electronic device intended to 
receive acoustic signals, cancel non- stationary interfering 
signals and output a filtered acoustic signal to be received 
20 by the speech recognition system's microphone. 

ECAD sound source 4 01 (such as the signals output 
loudspeakers 101 and 102 of Figure 1) may be received 
directly by a spectral analysis process 404 so that the 
signal as produced by the ECAD prior to transmission through 
2 5 the in-car acoustic channel 4 03 may be analysed. The ECAD 
signal is also received by a spectral analysis process 405 
after transmission through acoustic channel 4 03 so that the 
signal 401 is in effect simultaneously spectrally analysed 
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before and after transmission through the acoustic channel 
403. The spectral analysis of processes 404 and 405 is 
preferably carried out at a 16 ms frame rate using a 256 
point Fast Fourier Transformer. If user speech 4 02 (corre- 
5 sponding to wanted speech signal S(jo>) 104 of Figure 1) is 
also present then this acoustic signal too will also be 
transmitted through the acoustic channel 403 and received by 
spectral analysis process 405. 

The output of spectral analysis processes 4 04 and 405 

10 are used as inputs to acoustic channel model estimation 
process 4 06 which preferably functions in accordance with 
algorithm 200 described herein above. Acoustic channel 
model estimation process 4 06 produces an acoustic channel 
model 4 07 which may be used as an input to a spectral 

15 subtraction process 408 which also receives the acoustic 
signal transferred through channel 403. 

When the speech recognition system is required, the 
acoustic channel model 407 is frozen for duration of the 
speech recognition process. The acoustic channel model 407 

2 0 is then used to recover the speech signal from the micro- 
phone signal by subtracting the estimated spectrum of the 
ECAD interfering signals contained in the model 407 from the 
acoustic signals received at the microphone. The spectrally 
subtracted signal representing the recovered wanted speech 

25 409 is then passed to a pattern matcher process 410 (part of 
the speech recognition system) which may use recognition 
feature sets such as Hidden Markov of models 311 in order to 
match the recovered speech signal 409 to a command which is 
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recognised by the system. The pattern matcher 4 09 may then 
pass on an output signal to trace back and decision process 
412 in order that the user's speech command be carried out 
by the device. 

5 Since the spectral subtraction algorithm is frame 

rather than sample based, its computational complexity is 
low. The algorithm's main computation is required for the 
Fast Fourier Transform, which requires order NlogN computa- 
tions per frame for each channel. This is typically only 

10 about 250k computations per second, which is significantly 
lower than the order 3N computations per sample required by 
the simplest form of known adaptive filter technique. For 
an echo tail length of 32 microseconds, 256 samples, this 
equates to more than 18 million operations per second. 

15 Figures 5 to 8 of the accompanying diagrams illustrate 

microphone signal traces before and after the non- stationary 
interferer signal cancellation for different types of music 
output by the ECAD at different signal to interference 
ratios. In order to allow for comparison between an 

20 uncancelled signal passed through the acoustic channel and 
the cancelled signal, test data was constructed by recording 
speech and interferer signals separately in the same car 
environment and then adding the two signals. In the 
examples shown in figures 5 to 8, the interfering music is 

25 a stereo signal. 

Figures 5A to 5D of the accompanying drawings illus- 
trate microphone traces with and without cancellation in a 
case where the ECAD outputs pop music at OdB signal to 
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20 



25 



interference ratio. in Fig. 5A a signal received at the 
microphone prior to cancellation is illustrated. in this 
case, peak segmental speech and interferer levels are the 
same. This is a highly pessimistic way of estimating 
signal-to-noise ratio as amplitude variability of speech 
signal is higher than that of the ECAD music signal output 
which exceeds the speech for a considerable part of the 
example. Fig. 5B illustrates a signal resulting from an 
inverse transformation on the signal of Fig. 5A after 
spectral subtraction. The interfering signal as shown in 
Fig. 5B has clearly been reduced. Fig. 5C illustrates a 
signal representing normalised squared cepstral distances 
for application of the cancellation algorithm. Fig. 5D 
illustrates a signal trace for the normalised squared 
cepstral distances of Fig. 5C after spectral subtraction. 
Comparing the traces illustrated in Fig. 5C and 5D, it can 
be seen that the recovered speech cepstral are less dis- 
torted than with the interferer. 

Figures 6A to 6D of the accompanying drawings illus- 
trate microphone traces with and without cancellation in a 
case where the ECAD outputs pop music at 10 decibel signal 
to interference ratio. In Fig. 6A a signal received at the 
microphone prior to cancellation is illustrated. Fig. 6B. 
illustrates a signal resulting from an inverse transform- 
ation on the signal of 6A after spectral subtraction. The 
interfering signal shown in Fig. 6B has clearly been 
reduced. Fig. 6C illustrates a signal representing 
normalised squared cepstral distances for application of the 
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cancellation algorithm. Fig. 6D illustrates a signal trace 
for the normalised square cepstral distances of Fig. 6C 
after spectral subtraction. 

Figures 7A to 7D of the accompanying drawings illus- 
5 trate microphone traces with and without cancellation in a 
case where the ECAD outputs opera music at 0 decibel signal 
to interference ratio. In Fig. 7A a signal received at the 
microphone prior to cancellation is illustrated. Fig. 7B. 
illustrates a signal resulting from an inverse transform- 

10 at ion on the signal of 7A after spectral subtraction. The 
interfering signal shown in Fig. 7B has clearly been 
reduced. Fig. 7C illustrates a signal representing 

normalised squared cepstral distances for application of the 
cancellation algorithm. Fig. 7D illustrates a signal trace 

15 for the normalised square cepstral distances of Fig. 7C 
after spectral subtraction. 

Figures 8A to 8D of the accompanying drawings illus- 
trate microphone traces with and without cancellation in a 
case where the ECAD outputs opera music at 10 decibel signal 

20 to interference ratio. In Fig. 8A a signal received at the 
microphone prior to cancellation is illustrated. Fig. 8B. 
illustrates a signal resulting from an inverse transform- 
ation on the signal of 8A after spectral subtraction. The 
interfering signal shown in Fig. 8B has clearly been 

25 reduced. Fig. 8C. illustrates a signal representing 
normalised squared cepstral distances for application of the 
cancellation algorithm. Fig. 8D illustrates a signal trace 
for the normalised square cepstral distances of Fig. 8C 
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after spectral subtraction. 
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Claims 

1. Apparatus for cancellation of one or more non-station- 
ary interfering signals for speech recognition, said 
apparatus including : 
5 means for receiving an acoustic signal; 

means for generating an estimated value of a magnitude 
spectrum of said non- stationary interfering signals; and 

means for subtracting said estimated value from said 
received acoustic signal to produce a representation of a 
10 wanted speech magnitude spectrum. 

2. Apparatus according to claim 1, wherein said means for 
generating estimated value includes processing means 
configured to estimate a transfer function for an acoustic 
channel between each source of said non- stationary interfer- 

15 ing signals and said means for receiving an acoustic signal . 

3. Apparatus according to claim 2, wherein said processing 
means is configured to estimate transfer functions for said 
non-stationary interfering signals produced by left and 
right stereo channel transmissions. 

20 4. Apparatus according to Claim 2 or Claim 3, wherein said 
estimation of said transfer functions is achieved by said 
processing means executing an iterative algorithm on a 
frame-by-frame basis, the frames being constituted by said 
acoustic signals received during successive time periods. 

25 5. Apparatus according to Claim 4 when dependent upon 
Claim 3, wherein said processing means is configured to 
estimate respective magnitudes of said left and right 
channel interference signals, 
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said magnitude of left channel interference signal is 
estimated by subtracting said right channel interference 
signal magnitude estimated during previous said iteration 
from said acoustic signal received at current said iter- 
5 at ion; and 

said magnitude of right channel interference signal is 
estimated by subtracting said left channel interference 
signal magnitude estimated during previous said iteration 
from said acoustic signal received at current said iter- 
10 ation. 

6. Apparatus according to Claim 5, wherein said transfer 
function estimate for said right stereo acoustic channel is 
determined by dividing said right channel interference 
magnitude estimate by said interfering signal transmitted 

15 from said right acoustic stereo channel; and 

said transfer function estimate for said left stereo 
acoustic channel is determined by dividing said left channel 
interference magnitude estimate by said interfering signal 
transmitted from said left acoustic stereo channel. 

20 7. Apparatus according to Claim 6, wherein said right 
acoustic channel transfer function estimation is performed 
for a said iteration only if a ratio of total energy of said 
right acoustic stereo channel interfering signal over total 
energy of said left acoustic stereo channel interfering 

25 signal exceeds a predetermined threshold value; and 

said left acoustic channel transfer function estimation 
is performed for a said iteration only if a ratio of total 
energy of said left acoustic stereo channel interfering 
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signal over total energy of said right acoustic stereo 
channel interfering signal exceeds a predetermined threshold 
value . 

8. Apparatus according to Claim 7, wherein said ratio and 
5 threshold comparisons are applied to individual frequency 

components in spectra of said signals. 

9. Apparatus according to Claim 8, wherein said left and 
right stereo acoustic channel transfer functions are 
multiplied by (l-|T|(k)|) where 11 (k) is coherence of said 

10 left and right interfering signals at a frequency index k. 

10. Apparatus according to Claim 4, wherein said transfer 
function estimate for said right stereo acoustic channel is 
obtained using an expression: 

H m - rt*> - H ** lk) - R " {k) -n i k ) 

and said transfer functions estimate for said left stereo 
15 acoustic channel is obtained using an expression: 



wherein R" (k)=H CR (k) .C(k) , with C(k) being a common component 
of said left and right stereo channel signals and H CR (k) is 
a transfer function between common said left and right 
stereo channel transmissions, and said right stereo channel 
20 and L" (k) =L (k) -H CL (k) . C (k) , where H CL (k) is a transfer 
function between common said left and right stereo channel 
transmissions and said left stereo channel signal. 
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11. Apparatus according to any one of claims 2 to 10, 
wherein said processing means further comprises means for 
smoothing said estimated transfer functions in time domain. 

12. Apparatus according to claim 11, wherein said means for 
5 smoothing in time domain comprises a first order recursive 

filter. 

13. Apparatus according to any one of claims 2 to 12, 
wherein said processing means further comprises means for 
smoothing said estimated transfer functions in frequency 

10 domain. 

14. Apparatus according to Claim 13, wherein said means for 
smoothing in frequency domain comprises a Finite Impulse 
Response filter. 

15. Apparatus according to any one of claims 2 to 14, 
15 wherein said processing means includes means for performing 

a Fourier Transform. 

16. Apparatus according to any of the preceding claims, 
wherein said non- stationary interfering signals are produced 
by an electronic acoustic device operating in a vehicle. 

20 17. Apparatus according to any one of the preceding claims, 
wherein said means for receiving an acoustic signal com- 
prises a microphone. 

18. A method of cancellation of one or more non-stationary 
interfering signals for speech recognition, said method 
25 including steps of: 

receiving an acoustic signal; 

generating an estimated value for a magnitude spectrum 
of said non- stationary interfering signal; and 
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subtracting said estimated value from said received 
acoustic signal to produce a representation of a wanted 
speech magnitude spectrum. 

19. Method according to Claim 18, wherein said step of 
5 generating an estimated value comprises estimating a 

transfer function for an acoustic channel between each 
source of said non- stationary interfering signals and said 
means for receiving an acoustic signal. 

20. Method according to Claim 19, wherein said transfer 
10 functions are estimated for non- stationary interfering 

signals produced by left and right stereo channel trans- 
missions . 

21. Method according to any one of Claims 18 to 20, wherein 
said steps are executed iteratively on a frame -by- frame 

15 basis, the frames being constituted by said acoustic signals 
received during successive time periods - 

22. Method according to Claim 21, when dependent upon Claim 
20, wherein said step of estimating a transfer function 
includes : 

2 0 estimating a magnitude of said left channel interfer- 

ence signal by subtracting said right channel interference 
signal magnitude estimated during previous said iteration 
from said acoustic signal received at current said iter- 
ation; and 

25 estimating magnitude of said right channel interference 

signal by subtracting said left channel interference signal 
magnitude estimated during previous said iteration from said 
acoustic signal received at current said iteration. 
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23. Method according to Claim 22, further comprising steps 
of: 

dividing ' said right channel interference magnitude 
estimate by said interfering signal transmitted from said 
5 right acoustic stereo channel; and 

dividing said left channel interference magnitude 
estimated by said interfering signal transmitted from said 
left acoustic stereo channel. 

24. Method according to Claim 23, wherein said step of 
10 estimating right acoustic channel transfer function is 

performed for a said iteration only if a ratio of total 
energy of said right acoustic stereo channel interfering 
signal over total energy of said left acoustic stereo 
channel interfering signal exceeds a predetermined threshold 

15 value; and 

said step of estimating left acoustic channel transfer 
function estimate is performed for a said iteration only if 
a ratio of total energy of said left acoustic stereo channel 
interfering signal over total energy of said right acoustic 

2 0 stereo channel interfering signal exceeds a predetermined 
threshold value . 

25. Method according to Claim 24, wherein said ratio and 
threshold comparisons are applied to individual frequency 
components in spectra of said signals. 

I 25 26. Method according to Claim 25, wherein said left and 

l 

1 right stereo acoustic channel transfer functions are 

multiplied by (l-|ti(k)|) where ti (k) is coherence of said 
left and right interfering signals at a frequency index k. 
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27. Method according to Claim 21 , wherein said transfer 
function estimate for said right stereo acoustic channel is 
obtained using an expression: 



R"(k) R"{k) 



and said transfer functions estimate for said left stereo 
5 acoustic channel is obtained using an expression: 

M L"(k) L"(k) AL 

wherein R" (k)=H CR (k) -C(k) , with C (k) being a common component 
of said left and right stereo channel signals and H CR (k) is 
a transfer function between common said left and right 
stereo channel transmissions, and said right stereo channel 
10 and L" (k) =L(k) -H CIi (k) . C(k) , where H CL (k) is a transfer 
function between common said left and right stereo channel 
transmissions and said left stereo channel signal . 

28. Method according to any one of Claims 18 to 27, 
further comprising a step of smoothing said estimated 

15 transfer functions in time domain. 

29. Method according to any one of Claims 18 to 28, further 
comprising a step of smoothing said estimated transfer 
functions in frequency domain. 

30. A speech recognition system including apparatus 
20 according to any one of claims 1 to 17. 

31. An electronic acoustic device including apparatus 
according to any one of claims 1 to 17. 



WO 00/68936 




PCT/GB00/01715 



1/8 



Right LS 



RQo>) 



L(ja>) 



102 



101 



A 



106 



1 
i 



H A r Qa>) 



T" 

i 



Microphone 
Signal, 

Y(j<o) 



105 



V 



H AL Q<0) 

i 

I 
I 



Or 

v 103 



Left LS 



J 



,104 



Wanted speech 

S(jo>) 



Fig.l 



WO 00/68936 




PCT/GB00/01715 



2/8 



INITIALISE ESTIMATES OF 
MAGNITUDES OF LEFT AND 
RIGHT TRANSFER FUNCTIONS 
Hal> Har 



I 



-201 



INITIALISE ESTIMATES OF 
LEFT AND RIGHT CHANNEL 
INTERFERENCE, C L AND C R , AT 
MICROPHONE 



-202 



I 



MAKE NEW ESTIMATES OF 
LEFT AND RIGHT CHANNEL 
INTERFERENCE, C L AND C R 



I 



MAKE ROUGH ESTIMATES OF 
LEFT AND RIGHT CHANNEL 
TRANSFER FUNCTIONS H AL , H AR 



-20/. 



I 



SMOOTH ROUGH ESTIMATES OF 
Hal, H A r IN TIME AND 
FREQUENCY DOMAINS 



-205 



200 



Fig. 2 



WO 00/68936 




PCT/GB00/01715 



3/8 




Fig. 3 



WO 00/68936 




PCT/GBOO/01715 



CVI 



C3 



r 

TRACEBACK 
& DECISION 










1 

PATTERN 
MATCHER 









4/8 





CD 
^1 



WO 00/68936 





PCT/GB00/0I715 



5/8 




200 



£00 600 800 1000 1200 U00 



Fig. 5 A 



0.2 
0 

-0.2 



ICE cancelled microphone signal | 



icropnone signal | . i 



200 £00 600 800 1000 1200 U00 



Fig. 5B 



0.01- 
0.005 
0 



"i r 



-i r 



% MFCC diff. power - WITHOUT cancellation 




100 200 300 £00 500 600 700 800 900 1000 TI00 



Fig. 5C 



0.01- 
0.005 



t 1 — 1 r 



% MFCC diff. power - WITH cancellation | 



gi>diJ-Li,.L . ..a* In, i. ...... s™- m 



100 200 300 400 500 600 700 800 900 1000 TI00 



Fig. 5D 



WO 00/68936 



PCT/GB00/01715 



0.2 
0 



6/8 



-0.2 



Uncancelled microphone signal 



200 



£00 600 800 1000 1200 1£00 




200 



£00 600 800 1000 1200 U00 



Fig. 6B 



t r 



-i r 



0.01- 
0.005- 



0 



% MFCC diff. power - WITHOUT cancellation 



100 200 300 £00 500 600 700 800 900 1000 1100 



Fig. 6C 



0.01- 
0.005- 




100 200 300 £00 500 600 700 800 900 1000 TI00 



Fig. 6D 



WO 00/68936 




t 



PCT/GBOO/01715 



0.2 



7/8 



o- 



-0.2 



Uncancelled microphone signal I 




0.2 
0 

-0.2 



200 400 600 800 1000 1200 1400 



Fig. 7 A 



ICE cancelled microphone signal ^ 



0.01 
0.005 
0 



200 



400 600 800 1000 1200 1400 



Fig. 7B 



■ • 



-i r 



% MFCC diff. power - WITHOUT cancellation 




VITHOUT cancellation | 



100 200 300 400 500 600 700 800 900 1000 TI00 



Fig. 7C 



0.01- [ 
0.005- 

0 — 



-i r 



-i 1 1 i r 



% MFCC diff. power - WITH cancellation 



uli dm* A .fc* 



nation 



100 200 300 400 500 600 700 800 900 1000 1100 



Fig. 7D 



WO 00/68936 




t 



PCT/GB00/01715 



0-2 
0 

-0.2 



8/8 




200 



LOO 600 800 1000 1200 1400 



Fig. 8 A 



ICE cancel led microphone signal 



0.01- 
0.005- 

0 



200 



£00 600 800 1000 1200 U00 



Fig. 8B 



-i nr 



i i 



% MFCC diff. power - WITHOUT cancellation [ 



A 



I I 



100 200 300 £00 500 600 700 800 900 1000 1100 



Fig. 8C 



0.01- 
0.005 

0 



% MFCC diff. power - WITH cancellation 



-J L 



1 Wk 



100 200 300 £00 500 600 700 800 900 1000 T100 



Fig. 8D 



INTERN. 



AL SEARCH REPORT 




I Application No 

PCT/GB 00/01715 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC 7 G10L21/02 G10L15/20 



According to International Patent Classification (IPC) or to both national classification and IPC 



a FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 7 G10L 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and. where practical, search terms used) 

EPO-Internal, WPI Data, PAJ, INSPEC, COMPENDEX, IBM-TDB 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° Citation of document, with ind cation, where appropriate, of the relevant passages 



Relevant to daim No. 



EP 0 856 834 A (NIPPON ELECTRIC CO) 
5 August 1998 (1998-08-05) 
abstract; claim 1; figure 5 

US 5 864 804 A (KALVERAM HANS) 
26 January 1999 (1999-01-26) 
abstract; figure 2 
column 2, line 1 - line 15 
column 2, line 61 - line 65 



1.2,18, 
19 



1.2,18, 
19 



□ 



Further documents are listed in the continuation of box C. 



0 



Patent family members are listed in annex. 



° Special categories of cited documents : 

'A - document defining the general state of the art which is not 
considered to be of particular relevance 

*E" earlier document but published on or after the international 
fifing date 

"L" document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use. exhibition or 
other means 

"P" document published prior to the international filing date but 
later than the priority date claimed 



T later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 

cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent family 



Date of the actual completion of the international search 



15 August 2000 



Date of mailing of the international search report 



22/08/2000 



Name and mailing address of the ISA 

European Patent Office. P.B. 5818 Patent! aan 2 
NL-2280HV Rijswi* 
Tel. (+31 -70) 340-2040. Tx. 31 651 epo nl. 
Fax: (431-70) 340-3016 



Authorized officer 



Van Doremalen, J 



Form PCT/ISA/210 (second Sheet) (July 1992) 



INTERNA 



SEARCH REPORT 

li. formation on patent family members 




I Application Mo 

PCT/6B 00/01715 



Patent document 
cited in search report 



Publication 
date 



Patent family 
members) 



Publication 
date 



EP 0856834 



05-08-1998 



JP 
JP 
AU 
CA 
US 



2930101 B 
10215194 A 
5278798 A 
2228121 A 
5978824 A 



03-08-1999 
11-08-1998 
06-08-1998 
29-07-1998 
02-11-1999 



US 5864804 



26-01-1999 



DE 
EP 
JP 



19521258 A 
0747880 A 
9006388 A 



12-12-1996 
11-12-1996 
10-01-1997 



Form PCT/lSA/210 (patent tamty annex) (July 1992) 



24-OCT-2001 16:23 FROM Wynne- Jones Laine & James TO 

{ - HINT COOPERATION TREAT\ 



90018592520779 P. 05/09 



PCT 



INTERNATIONAL SEARCH REPORT 

(PCT Article 18 and Rules 43 and 44) 



Applicant's or agenf s file reference 

BKCD/I J/ENS7 



International application No. 
PCT/ 68 00/01715 



FOR FURTHER see Notification of Transmittal of IntemationaJ Search Report 
ACTION (Forrn pcrrA ^ A ^ 2 °) as wort as, where applicable, item 5 below. 



Internationa] filing date (day/montft/year) 

05/05/2000 



(Earliest) Priority Date (<Say/month/year) 

07/05/1999 



Applicant 



ENSIGMA LIMITED et al 



TOs ^temat^Seaicn Report has been prepared by this IntemationaJ Searching Authority and is transmitted to the applicant 
aceord>ng to Article 1 a A copy is being transmitted to the International Bureau. ^ 

This international Search Report consists of a total of 2 sheets. 

it is also accompanied by a copy of each prior art document cited in this report 



1. Baste of the report 

a. With regard to the language, the international search was earned out on the basis of the international application in the 
language in which ft was filed, unless otherwise indicated under this item. 

CI international search was carried out on the basis of a translation of the international application furnished to this 

Authority (Rule 23.1(b)). 

b. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international search 
was carried out on the basis of the sequence listing : 

CI contained in the international application in written form. 

CI ffl® 0 " together with the international application in computer readable form. 

fl furnished subsequently to this Authority in written form. 

I I furnished subsequently to this Authority in computer readbleform. 

I I the statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

Q the statement that the information recorded in computer readable form is identical to the written sequence listing has been 
furnished 

Z Q Certain cfalms were found unsearchable (See Box I), 
a □ Unity of Invention te lacking (see Bo* II). 

4 With regard to the tttte, 

f^l the text is approved as submitted by the applicant 

I I the text has been established by this Authority to read as follows: 



5. With regard to the abstract, 

PH the text is approved as submitted by the applicant, 

| [ the text has been established, according to Rule 38.2(b), by this Authority as it appears in Box IIL The applicant may, 
1 within one month from the date of mailing of this international search report submit comments to this Authority. 

a The figure of the drawings to bo published with the abstract is Rgure No. .J 

|TJ as suggested by the applicant. Q None of the figures. 

I I because the applicant failed to suggest a figure. 

I I because this Rgure better characterizes the invention. 



Form PCT ASA/210 (first sheet) (Jury 1998) 



Best Available Copy 



24-OCT-2001 16:22 FROM Wynne-Jones Laine & James TO 

1NTEF' ONAL SEARCH REPORT* 



90018592520779 P . 04/09 



A. CUxSSlRCATION OF SUBJECT MATTER 

IPC 7 G10L21/02 G10L15/20 



0 



rtal Application No 
PCT/GB 00/0171S 



According to International Patent Qassification (IPC) Of to both national dasgfteajgori and IPC 
a HELDS SEARCHED 



^j^^docu^nwjon searched (Classification system followed by classification symbols) 



Oocumentalion searched other than rwnimurn documentation to the extent that such documents 



are included in the fields searched 



eoctror»c data base consulted Airing the international search (nam* of data baso and. where practical, search terms used) 

EPO-Internal , WPI Data, PAJ, INSPEC, COMPENDEX, IBPMTDB 



C DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° 



Citation of document, with Indication, wnere appropriate, of the relevant passages 



EP 0 856 834 A (NIPPON ELECTRIC CO) 
5 August 1998 (1998-08-05) 
abstract; claim 1; figure 5 

US 5 864 804 A (KALVERAM HANS) 
26 January 1999 (1999-01-26) 
abstract; figure 2 
column 2, line 1 - line 15 - 
column 2, line 61 - line 65 



□ 



Relevant to daim No. 



1,2,18, 
19 



1,2,18, 
19 



Further documents are listed in the continuation of box C. 



' Special categories of cited cecum ems : 



a 



Patent family members are listed in annex. 



"A- document defining the general state of the art which Is not 

considered to be of particular reJevance 
"E" earlier document but published on or after The international 

filing date 

V document which may throw doubts on priority derm's) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

*0* document referring to an oral disclosure, use. exn&tion or 
other means 

'P* document published odor to the international King date but 
later than (he priority date d aimed 



T" later document pubUsned after the international filing, date 
or priority date and not in conffict wiih the application out 
cited to understand the principle or dieory underlying the 
invention 

"X" document of particular relevance; the claimed Invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

T" document Of particular relevance: the claimed Invention 

cannot be censiddred to involve an inventive step when tne 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the same patent famdy 



Date of me actual completion of the international search 

15 August 2000 



Date of mailing of the international search report 

22/08/2000 



Name and mailing address of the ISA 

European Patent Office. P.B. 581 8 Patenflaan 2 
NL — 2280 HV Rjjswijk 
Tel. (+O1-70) 340-2040, T*. 31 651 epo r*. 
Fa*r<*31~70) 340-0016 



Authorized officer 



Van Doremalen, J 



Form *CT/lSA£io (s#oood she*) (Jury 1982) 



24-OCT-2001 16:22 FROM Wynne-Jones Laine & James TO 

INTEP* ONAL SEARCH REPORT 

v t *«on on patent family members 



90018592520779 P. 03/09 



r . Mai Application No 

Vv/f/GB 00/01715 



1 _ 

Patent document 
cited in searcn report 


Publication 
I date 


Patent family 
members) 


Publication 
date 


EP 0856834 A 


05-08-1998 


JP 


2930101 B 


03-08-1999 






JP 


10215194 A 


11-08-1998 






AU 


5278798 A 


06-08-1998 






CA 


2228121 A 


29-07-1998 






US 


5978824 A 


02-11-1999 


US 5864804 A 


26-01-1999 


DE 
EP 
JP 


19521258 A 
0747880 A 
9006388 A 


12-12-1996 
11-12-1996 
10-01-1997 



ftjrm PCT/tSA/210 <pown tomily ennox) (JUy 1 992) 



. 24M3CT-2001 16=24 FROM Wynne- Jones Laine & James TO 90018592520779 P. 08/09 

.fENT COOPERATION TREAT ' " ~° 



From the INTERNATIONAL SEARCHING AUTHORITY 


PCT 


To: 


Wynne- Jones, Laine & James 
Attn, DUNLOP, Brian Kenneth C. 
22 Rodnev RnaH 
Cheltenham 

Gloucestershire, SL50 1JJ 


NOTIFICATION OF TRANSMITTAL OF 
THE INTERNATIONAL SEARCH REPORT 
OR THE DECLARATION 

(PCT Rule 44.1) 

- 




Date of mailing 

(day/month/year) 22/08/2000 


Applicant's or agents file reference 
8KCD/IJ/ENS7 


FOR FURTHER ACTION See paragraphs i and 4 below 


international application No. 
PCT/GB 00/01715 


International filing date 
(Wmon****) 05/05/2000 


Applicant 




ENSIGMA LIMITED et al . 





1- [Xl The applicant is hereby notified that the International Search Report has been established and 13 transmitted herewith. 
Filing of amendments and statement under Article 19: 

The applicant is entitled, if he so wishes, to amend the claims of the International Application (see Rule 46); 

When? The time limit for fifing such amendments is normally 2 months from the date of transmittal of the 
international Search Report; however, for more details, see the notes on the accompanying sheet 

Where? Directly to me International Bureau of WIPO 
34, chemin des Colombettes 
121 1 Geneva 2a Switzerland 
Fascirnile No.: (41 -22) 740.1 4,35 

For more detailed Instructions, see the notes on the accompanying sheet 

z □ ^t^^^^^T^ ^ Report wi " ** ^ ,h * -—■»«»-» 

1 □ Wtth regard to the protest against payment of (an) additional fee(s) under Rule 40-2, the applicant is notified that 

□ »™k~^ S^JTE ^L e Jt? S !° n thG T^° n transmitte « to International Bureau together with the 

applicant's request to forward the texts of both the protest and the decision thereon to the designated Offices. 

CD no decision nas ^de yet on the protest; the applicant will be notified as soon as a decision is made. 
4. Further actions): The applicant is reminded of the following; 

^f°2£ fS^Ll 8 ^^ ?° m "£ date * *» *nternational application will be published by the InternationaJ Bureau, 

ff^appficant wishes to avoid or postpone publication, a notice of withdrawal of the international appficatioa or of the 
priority clairn^ must reach the International Bureau as provided in Rules 90Ws.1 and 90&&.3. resoea^^oVe me 
completion of the technical preparations for international publication, respectively, Detore the 

W ^^^^^^^t^^' t**™™? for in * 1 m j? iona, ^ fimlnaf y ««ntaltan must be filed if the applicant 
wisnes to postpone the entry mto the national phase until 30 months from the priority date (in some Offices even later). 

W ^rToIT^^I^^ ^ rior ^J??* tne a PP« cant Perform the prescribed acts for entry into the national phase 
n2?r£ *1?™?"*^Z?^ S f™*! ^ ave *** 13680 e{ected if) *>e demand or in a later election within 19 months from the 
pnorrty date or could not be elected because they are not bound by Chapter (1 



N ame and m aiing address of the International Searching Authority 

J European Patent Office, P.B. 581 8 Patentiaan 2 
NL-2280NVRijsw*k 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl, 
... Fax (+31-70) 340-3016 ' 



Authorized officer 

Lucia Van Pinxteren 



Form PCT/ISA/220 (July t996) 



24-QCT-2001 16:24 FROM Wynne- Jones Laine & James TO 



90018592520779 P - 07/09 



N6 . TO FORM PCT/!SA#20 



Thw« Notas a« mtended to 9™** basic instructions concerning the filing of amendments under arbcie 19. The 

und^ C^Tn^TT 6 ^ °* 2 oopmiian Tr9 * y > Elation* and the Ackninistrative lr»rnictbns 

^^2J^L ^ d ^f^7 t»twe#n theaeNotoi end those requirements, the fatter are applicable For mom 

detailed information, see also the PCT Applicant's Guide, a publication of WIPO. w 

Ae^M^ ^ ft ° PCT, the PCT Regulations and the PCT 



~_ INSTRUCTIONS concerning AMENDMENTS UNDER ARTICLE 19 

•ntem^S^L^ ^ ^EE!!^^ international search report, one opportunity to amend the claims of the 
9h ° l l^ ho ^^^^a«>»d that, since all parts of the international application (daimT 
t^^^J^^^ T^t^TL^ irrational preliminary examination proce^^^uX 
no need to ffie amendmanta of the dome under Article t 9 except where, e.g. the applicant want* the latter to be ^wuk«h 
P^^^^^ 5 ^^!^ f •»«■«*'•' or amendSg the Ifcame^^ 

Furthermore, 4 should foe emphasized that prerenal protection la avaiiabJe in some States only. pouKcanon. 

What parts of the International application may be amended? 

Under Article 19, only the claims may be amended, 

J^f*^*^** P*«*«> c*«ms may also be amended (or further amended) under Article 34 before 
^ Inteme^onal ^^nary Examining Authority. The description and drawings may only be amended under 
Article 34 before the IntemattonaJ Examining Authority. 

Upon entry into the nation aJ phase, ail parts of the international application may be amended under Article 28 
or, where applicable. Article 41 , 



When? 



Wthm 2 months from the date of transmittal of the international search report or 1 6 months from the priority 
date, whichever tome hrmt expires later. It should be noted, however, mat the amendments win be censioered 
f^t£ ff.T?*" S $C ^L° i L bm t rf OT International Bureau after the exprratron of the 

ap?*cabte hme limit but before the completion of the technical preparations for international publication 

(nlllfl 40.1 ), 



Where not to file the amendments? 



The amendments may only be fled with the International Bureau and not with the receiving Office or the 
International Searching Authority (Rule 46.2), 

Where a demand for international presminary examination has been /i a filed, see below. 



How? 



Ether by cancellme.c™ or more entire claims, by adding one or more new claims or by amending the text of 
one or more of the claims as ffled. 

t^^^J^^J?* »t^rt <™ *ich sheet of the daims which, on account of an amendment or 
amendments, differs from the sheet on gin ally filed. 



All th»daima appeanng on a replacement sheet must be numbered in Arabic numerals. Where a dmm is 
cancelled, no ^numbering of the other claims is required. In a* cases where claims are renumbered, they must 
be renumbered consecutively (Administrative Instructions, Section 205(b)). 

The amendments must be made In the language in which the International application is to be published. 



Whet documents must/may accompany the amendments? 
Letter (Section 205(b)): 

The amendments must be submitted with a letter. 

The letter will not be published with the international application and the amended claims. It should not be 
confused with the -Statement under Article 1 9(1 )* (*ee below, under 'Statement under Artide 19(1)-). 

VT! ^".r." 1 ^ *!? '"p 1 ^ or French, at the choice of the applicant. However. If the language of the 
btternattonal ^cation Is BioUsh, the letter must be In English, rf the tanguaoe of the International a, 
la French, the letter must bo In French. 1 



application 
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I^^T 1^ oWerences between the dams as filed and the daima go amended. It must, in 

S^S^'^^ COnn ° ct,0nwrth daim appearing in the international application (it bemg uncUrstood 
that identical mdcabona concerning several claims may be grouped), whether n«™ooa 

0) the claim is unchanged; 

(fi) the daim b cancelled; 

(w) the claim is new; 

flv) the daim replaces one or more daims as Bled; 

(v) the claim is the result of the division of a daim aa fled. 



The following exam plea 
accompanying letter 



the manner In which amendments must be explained in the 



1 TS^^^ T™* 8 **er amemiment of some claims them arc 51]: 

?J2\a to "J*.* 1 *!** amondod same numbers; 

aatma 3D, 33 and 36 unchanged; new daims 49 to 51 added.* 



2. 



3. 



(Where wigmajly there were 1 S daims and after amendment of aft daims there are 11!' 
aaims 1 to 15 replaced by amended daims 1 to It.- 

jW^ontfnally there were 14 claims and the amendments consist m canceling acme claim a and in adding 

XJajms i to 6 and 14 unchanged; daims 7 to 13 Cancelled; new daims 15. 16 and 17 added.- or 
•Claim* 7 to 13 cancelled; new claims 1 5, 16 and 17 added; ail other daims unchanged." 
{Where various Kinds of amendment* are made): 

CJaim, 1-10 unchanged; da™ 1 1 to 1 3, 18 and 19 cancelled; claims 14, 15 and 16 rec^eced by amended 
daim 14; daim 1 7 subdivided into amended daims 1 S, 16 and 1 7; new daim* 20 and 21 *o*ed? 



"Statement under article 19(1)- (Rut* 46.4) 

mat ^t^^ ^i^^^^J^^!^ V***** the amendments and indicating any impact 
ArtfJe^rT^ °° do8cnpt,on and *«^"9* (which cannot be amended under 

Tne statement wflf be published with the international application and the amended claims. 
It must be In the language In which the mtomattonaj apppflcatton Is to be published. 

R must be brief, not exceeding 500 words if in English or if translated into Eng&ih. 

l^lr^^ a ^^ ^ "n?^* ***** indioatmg the differences between the daims 

^l^- -l*? o 0 **™** ***** and must be identified as such by a heading, 

preferably by using the words •Statement under Article 1 9(1).' W 

l^n^I ^K^'l^^ P 1S? n9 f^"* °° n*™** 0 ™* search report or the relevance of citations 
n^^J^w hl dtahons, relevant to a given daim, contained in the international search 

report may be made only m connection with an amendment of that daim. 



Consequence ff a demand for International preliminary examination has already been filed 



h^lSJ^ ^ ***** 1 ?' a ^ mand "«™***™> preliminary examination 

tatainaneS^^ the W^^^ P^ably. at the same time of filing the amendments with the 



with regard to translation of the International application for entry Into the national phase 
^applicants attention ia drawn to the fact that, where upon entry into the national phase, a translation of the 

^hjrther details on the requirements of each designated/elected Office, see Volume If of the PCT Applicant's 
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REQUEST 



The undersigned requests that the present 
international application be processed 
according to the Patent Cooperation Treaty. 



Tor r' 




Internationa] Application No. 



International Filing Date 



Name of receiving Office and TCT international Application 7 * 



Applicant's or agent's file reference 

(if desireQ (12 characters maximum) BKCD/I J/ENS7 



Box No. 1 TITLE OF INVENTION » 

Cancellation of non-stationary interf er/ftignals for speech 
recognition 


Box No. II APPLICANT J 


Name and -address: (Family name followed by given name; for a legal entity, full official 
designation. The. address must include postal code and name of country. The country of the 
address indicated in this Box is the applicant's State (that is, country) of residence if no State 
of residence is indicated bclo**.) 

Ensignia Limited \ 
Turing House, 
Station Road, 
Chepstow. NP6 6PB 


|~ | This person is also inventor. 


Telephone No. J 


Facsimile No. j 


Teleprinter No. j 


State (that is. country) of nationality; 
United Kinedc>m 1 


Siate (that is. country) of residence: j 
United Kinedom 1 


This person is applicant i | ait designated | 1 all designated States except | — 1 the United States r~i ihc States indicated in 1 

for the purposes ofi 1 1 States - UJ the United States of America ] | of America only | J the Supplemental Box | 


Box No. III FURTHER APPLICANT(S) ANP/OR (FURTHER) INVENTORS) j 


Name and address: (Family name followed by given name: for a legal entity, full official 
designation The address must include postal code and name of country. The country of the 
address indicated in this Box is the applicant s State (that is. country) of residence if no State 
of residence is indicated belowj • ' 

CAREY, Michael John, 
Ensigma Limited, 
Turing. House, 
Station Road f 
Chepstow. NP6 6PB 


This person is: 

| { applicant only 

[ % applicant and inventor J 

|~| inventor only Of mis check-box j 
is marked do nut fill in belostj j 


State (that is. country) of nationality: 
United Kingdom 


State (that is. country) of residence: J 

United Kingdom | 


This person i$ applicant J j all designated 1 I all designated States except f— ] the United States [~ 1 the States indicated In J 
for [he purposes Of: 1 1 States - LJ the United States of Arnica UJ of America Onlv 1 1 the Supplemental Box | 


F^l Further applicants and/or (further) in ventors ore indiotfcxi oti a continuation sheet j 


Box No. IV At?ENT OR COMMON REPRESENTATIVE; OR ADDRESS FOR CORRESPONDENCE j 


Tne person identified below is hereby/has been appointed to act on behalf f— ] _ 
of the applicants) before the competent International Authorities as: L2J * sc 


ni [ j common representative* 



DUNLOP, Brian Kenneth Charles, 

Wynne-Jones, Laine & James, 

22 Rodney Road , 

Cheltenham, 

Glos. GL50 1JJ 

United Kingdom 



Telephone No. 

01242 515807 



Facsimile No. 

01242 224183 



Teleprinter No. 

437115 WYNPAT G 



□ Address for correspondence: Mark this check-box where no agent or common representative is/has been appointed and the 
space above is used instead to indicate a special ^6re$$ to which correspondence should he sent. 

-orm PCT/RO/IO! (first sheet) (July 1 998; reprint January 2000; — — - S<?* Notes to the request form 
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Continuation of Box No. II! F ? 7R APPLICANTS) ANTVOR (FURTHER) r !TOR($) 



If none of the foi. . Ang sub-boxes is used, (his sheet should not be\*nudcd in the request. 



I Name and address: (Family name followed by given name; for a legal entity full official 
1 designation. The address must include postal fcoae and ' name of country. The country of the 
I address indicated in this Box is the applicant s State (thai is. country) of residence if no State 
of residence is indicated below.) 

TA.TTERSALL, Graham David 
New House , 

Fristoo, " 
Saxmundham , 
Suffolk. IP17 1PH 
1 United Kingdom 


This person is: 

[ j applicant only 

j applicant and inventor 

[ j inventor only (If this check-box 
is marked, do not Jill in below.) 

■ 


I Slate (that is. country) of nationality; 
United Kingdom 


State (tltat is* country) of residence : 

United Kingdom | 


1 This person is applicant 1 1 all designated * | 1 all designated States except r~T| the United States f— | the States indicated m | 

for the purposes of: j J States ] | the United States of America 1 XI of America only [ J the Supplemental Box J 


Name and address: (Family name followed by given name; for a legal entity, fidl official 
j designation. The address must include postal code and name of country. The country of the 
address indicated in this Box is the applicant 's State (tliatis, country) of residence if no State 
of residence is indicated below,) 


- This person is: 1 
| [ applicant only 1 

J | applicant and inventor | 

. | | inventor only (If (his check-box I 
is marked, do not fill in below.) j 


j State (that is, country) of nationality; 


State (that is. country) of residence: 


I This person is applicant { — ] all designated | 1 all designated States except r— i the United Sts\es ( — n the States indicated in 1 

for the purposes of: | 1 States I J the United States of America £ J of America only 1 1 the Supplemental Box | 


Name and address: (Family name followed by given name; far a legal entity, full official 
I designation. Hie address must include postal code and name of country. The country of the 

address indicated in this Box is the applicant > State (that is, country) of residence if no State 
j of residence is indicated below.) 


This person is: I 
[ | applicant only I 

| [ applicant and inventor 1. 

| | inventor only (If thh check-box 1 

*— J is marked do not fill in below,) I • 


J State (that is. country) of nationality: j 


State (that is. country) of residence: 1 


pits person is applicant r- 1 aJI designated [~1 all designated States except r— I the United States i 1 the States indicated in j 

for the purposes of: 1 1 Slates f 1 the United States of America { J of America only j 1 the Supplemental Hox j 


Name and address; (Family name followed by given name; for a legal entity, full official 
designation. The address must include postal code and name of country. The country of the 
address indicated in this Box is the applicant s State (that is, country) of residence if no State -. 
of residence is indicated below.) 


S* 1 

This person is: J 
[_ | applicant only j 

| [ applicant and inventor ^ • j 

| | inventor only (If tius check-hex 1 
is marked do not fill in below.) j 


State (that is, country) of nationality: J 


State (that is. country) of residence: j 


This person is applicant j [ all designated I 1 all designated States except J 1 the United States | | the Stales indicated in I 

for the purposes of: I I Slates | [ the Unhed Stare* of Amenca | J of America only [ ( the Supplemental Vox 1 


(_ | Further applicants and/or (further) inventors arc indtcaicd on another continuation sheet. j 



Form PCT/RO/101 (continuation sheet) (July 1998; reprint January 2000) Sec Mates to the request form 
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Supplemental Box If the Supply * not used, this sheet should not be include tf >' \ : request. 



(0 



00 



A > in any of the Boxes, the spaced . .uffident to furnish all the information: in such ca, ^ite "Continuation of Box No. ... m 
[indicate Ihe number of the Box ) and furnish the information in the tamo manner OS required according to the captions of the Box in whicJt 
the space was insufficient, in particular: 

if more than two persons are involved as applicants and/or inventors and no 'continuation sheet " is available: in such we write 
l Cominuo^ 
counJryofthe^ 

below: 

ifinBoxNo.Ilorinanvoftliesvo-ooxexofBoxNo.Ili.fte 

Vsuchcase. write -Continuation of Box No. II* or "Continuation* of Box No. Ill or Continuation oj [Boxes ; No II and No IU 
as the casemav be), indicate the name of the applicants) involved and next to (each) such name, the Statefs) (and/or t ^iere 
applicable. ARIPO. Eurasian. European or OAP1 potent) for the purposes of whtch the named person is applicant; 

(Hi) if in Box No. II or in any of the sub-boxes of Box No. III. the inventor or the inventor/applicant ^ «^^ r /^^^f 
( J Valla^ignatedStatesorforthe C ^™? 0 "°{?J*?*"rtZ 
-Continuation of Box No 111* o? "Continuation of Boxes No, U and No, III" (as the case may be), indicate the name of the 
invemo^ *e s*l*re applicable. ARIPO . Eurasian, European or O API patent) far 

the purposes of which the named person is inventor; 

if. in addition to theagcnt(s) indicated in Box No. IV. dtere are further agents: in such case write "Continuation of Box No. IV" 
and indicate for each further agent the same type of information as required in Box No. IV; 

IfinBoxNo. V.thcnamcofanyStatt(orOAPl)isa*compan^ -patent of addition. " or Certificate of oddity 

V if in Box No. V, the name of the United States of America is accompanied by an indication *contitiuaiian or conttnuatio^ 
ZJLri" in such case write "Continuation of Box No. V" and the name of each State involved (or OAPl). and after the name of 
\£h*ucli %at1(or^Aiy) t tluXwnbZ of die parent title or parent application and the date of grant of the potent title or filing 
of the parent application: 

ifinBoxNo. VI. there are more than three earlier applications whose priority is claimed; insuchcase. write "Cortmuaiion of 
Box No. VI" and indicate for each additional earlier application the same type of information as required in Box No. Vi, 



Ov) 
(v) 

M 

(vii) 



if in Box No. VI the earUer application is an ARIPO application; in such case, write Continuation of Box No. VI . specify the 
number of the Uem corresponding to iliat earlier application and indicate at least one country party tot he Par* Convention for 
thTpZtZtion of Industrial Propfrty or one Mem&rofttv WorldTrade Organization for which that earlier application ^OS filed. 



2 If with retard to the precautionary designation statement contained in Box No. V. the applicant wishes to exclude any Statefs) from 
the scope of that statement; in such case, write "Designations) excluded from precautionary designation statement and indicate the 
name or two-letter code of each State so excluded 

3 Ifihe ODDlicant claims in respect of any designated Office, the benefits of provisions of the national law concerning non-prejudicial 
rtsclosur^ insuchcase. write "Statement 'concerning non-prejudicial disci osures or exceptions to lackr 
of novelty" and furnish that statement below. 

Continuation of Box iV 

Additional Agents: 

NEWELL, William Joseph 
LAINE f Simon James 
JAMES, Michael. John Gwynne 

all of 

Wynne-Jones , Laine & James 
22 Rodney Road 
Cheltenham 

Gloucestershire GL50 1JJ 
United Kingdom 

Telephone: 01242 515807 
Facsimile: 01242 224183 
Telex: 437115 WYNPAT G 
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Box No/ VI PRfORITY CLA'~ ' 



\ . - Filing date 

of earlier application 
(daWmomhfyear) 



item (I) 

7 May 1999 



. item (2) 



\ .umber 
bi earlier application 



□ Further priority c '» indicated in the Supplemental Box 



Why . . *lier application is: 



9910448.1 



national application; 
country 



GB 



regional application; 
regions] Office 



international application 
receiving Office^ 



item (3) 



Ql TJ>c "receiving Office is requested to prepare and transmit to the International Bureau a certified copy 
of the earlier applicanon(s) (only if the earlier application was fded with die Office which for the 
purposes of the present international application is the receiving Office) identified above as item<$) : 

■ Where the earlier application is an ARJPO application, it is mandatory to indicate m the Supplemental Box at least on* taunt™ nam tn d„~Z 
[ .Convcnnonfor ike Predion of Industrial Proper * for which that earlier application ' V ^ 



(1) 



Rox No. VII INTERNATIONAL SEARCHING AUTHORITY 



Choice of I n tern a tiona 1 Searching Authority (ISA) 

(if r\vO vr more International Search wg Authorities are 
I competent to carry out the international search^ indicate 
the Authority chosen: the r\*o»tettcr code may be used): 

[ISA/ 



Request to use results of earlier search; reference to tha* sea rcivOfan earlier 
search has been earned out by or rtquestedfroM the international Searclung Authority): 

Daiefaayfmenthycar) Number Country {or regional Office) 



1 Box No. VIII CHECK LIST; LANGUAGE OF FILING 



This international application contains 
I the following number of sheets: 

I request e, 

| description (excluding 
sequence listing pan) 

I claims 



abstract 

drawings 

| sequence listing part 
I of description 



29 

7 
1 
8 



I Total number of sheets : 50 



This international application is accompanied by the itcm(s) marked below; 

1. □ fee calculation sheet 

2. Q separate signed power of attorney 

3. Q copy of general power of attorney; reference number, if any: 

4. □ statement explaining lock of signature 

5. □ priority documents) identified in Box No. VI as itcm($); 

6. □ translation of international application into (language): 

7. Q separatcandications concerning deposited microorganism or other biological material 

8. O nucleotide and/or amino acid sequence listing in computer readable form 

9. □ other (specfo): 



Figure of the drawings which 
should accompany the abstract: 

1 Box No. IX SIGNATURE OF APPLICANT OR AGENT 



Language of filing of the 
international application: 



English 



JAMES, Michael John Gwynne (Representative) 



Date of act ual receipt of the purported 
international application: 



For receiving Office use only 



Corrected date of actual receipt due to later hui 
timely received papers or drawings completing 
tlte purponed international application: 



Dote of timely receipt of the required 
corrections under PCT Article 1 1(2): 



5. international Searching Authority TO . . 
(if two or more are competent); 1 o A / 



□ TrnnsmirtaJ of search copy delayed 
until search fee is paid. 



2. Drawings: *- 
| j received: 

f J not received; 



Date of receipt of the record copy 
by the International Bureau: 



For International Bureau use only , 
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ShcctNo.. 



BoxNo. V DESIGNATION OFSTATSS 



fanr* //iff applicable check-boxer, at hast one hmrt he marked): 



Thcfonowjngd«ignation3archcrcbyinadcundcfRuIc4.9(a) 
Region alPa tent 

Q AP ^^OPatentrCH Ghana/JM Gambia,KEKcnya, LSlxsotho,MWMalawi,SDSudan, SL Sierra I ,conc SZSwaziUmd 
P^oc^S UCUganda, ZWZ^babwe.andMyolhcrSuj^^ 

B KA Eur^an Patent: AM Amiaiia,AZ Azerbaijan, BYBcJaru*. KC Kyrgyzstan.KZ Kazakhstan, MD RcpubhcorMuldova, 

^erStt^^ScT >Stani T ^ urkm ^* lM * D ^>° lh ^ twh ^ KurasianPatcnt 
Q EP European Patent; AT Austria, *E Belgium, CH and U 



MCMonaco.NLNc?^ 



S OA 



Coo venuonand^fihcPCT 
OA PI Patent: BF BurkinaFaso, 



andan>ouSei$tatcwhicl3is^^ 

^^ n ^Fw^ ttU i^!, Ciin ^ cpublic ' CCConfio,. ClCotcd-lvoifc, CMCamcroon, 
y'Z^ 1 ^^^ 1 ^^}^^^^' MRMauntania. NENigcr, SNScnegai, TDChad TGToeojindany 
SS^S/ST™^^ ^OAPIandiContniehngStatcofthcPCT . 

National Patent (ijofasrkxndofprrtex*^^ 
H AEUnitedArabEmirates 

H AL Albania 

E3 AW Armenia 

51 AT Austria 

0AU Australia.. 
0 AZ Azerbaijan 
E BA Bosnia and Herzegovina . 
S BBBarbados 

BG Bulgaria 



S LR 
£3 LS 
BLT 
0 LU 
H LV 
El MA 

a md 



S BR Brazil 

H BY Belarus 

GO CA Canada 

0 CflandLI Swit2criandandLjcchten£lem 

S3 CN China 

□ CR CostaRica 

H CU Cuba 

GJ CZ Czech Republic 

H DB Germany 

G3 DK Denmark : 

fx] DM Dominica 

51 EE Estonia 

ED ES Spain 

63 FI Finland 

ED CB United Kingdom 
0 CB Grenada 

EJ GE Georgia ; 

H GH Ghana 

Q GM Gambia 

S HR Croatia, 

[X] HU 
S IJO 
SI IL 
0 IN 
EI IS 
0 JP 
0 KE 



Liberia 

Lesotho 

Lithuania 
Luxembourg 
Latvia 

Morocco... 

Republic ofMoJdova '.-I.' 

B MC Madagascar.. 

£3 MK The former Yugoslav Republic of Macedonia 



Hungary 

Indonesia 

Israel 

India.. 

Iceland 

Japan . 

Kenya 

EJ KG Kyrgyzstan , 

EJ KP Democratic People's Republic of Korca fc 



H\ NZ 
0 PL 
03 PT 

a ro 

Eel RU 

a sd 

E SE 
B SG 

Q si 

E SK 
a SL 

Btj 

JS TM 
El TR 
0 TT 
51 TZ 
H UA 
E UG 

Bus 



tXl MN Mongolia 

E MW Malawi 

13 MX Mexico 

El NO Norway 

NewZcaland 

Poland 

Portugal 

Romania 

Russian Federation ......... 

Sudan 
Sweden 
Singapore 

Slovenia 

Slovakia 

Sierra Leone 

Tajikistan 

Turkmenistan ... 

Turkey ; 

Trinidad and Tobago ; . . 

UnitcdRepublicofTanzanta 

Ukraine , , , , . k 

Uganda ,. ti 

United States of America . . 1 . 



0 UZ 
0 VN 

□ YV 

□ ZA 

H zw 

0 KR Republic ofKorea 

0 (CZ Kazakhstan 

ID LC SaintLueia 
0LK SriLanka 

PrccaurionuryDcsignafj0t£tarcntcnh Irod<litiomc<i)eacsignationsmadcabt>vc, lheapplicantalsoniakcaindcrRule4 9(b>iIlolhur 
a^gnahonswhicbwouldhcr*:riT^ ^ 
tomthcscor^onmsstatemenO al 
<i^grialionN\'bichisnob»nlii™ Uu^ppliaiiil 
alU>ccxpuatbnonhatlimclimtt. (Cc»^Mti^»^//</m^ 



Uzbekistan . ; 

VietNam 

Yugoslavia 

South Africa...,,. 

Zimbabwe 

Check-boxes reserved for designating States which ha>c 
becomcpartytolhel>CI aftcnssuai^rmisshcci: 

EJ ..AG 

ej ..nz 



KormFClTROf I 0 1 (sccondaheelXJ»nuaiy2(XX>) 



SecNotestatheretjuvxtfttrm 
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WG .. yTELI ECTTJAL PROPERTY ORGANIZATION 
International Bureau 




PCT 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patert Classification 7 
GIOL 21/02, 15/20 



Al 



(11) International Publication Number: WO 00/68936 

(43) International Publication Date: 16 November 2000 (16 J L00) 



(21) International Application Number: PCT/GB00/0I7I5 

(22) International Filing Date: 5 May 2000 (05.05*00) 



(30) Priority Data: 
9910448,1 



7 May 1999 (07:05.99) 



GB 



(71) Applicant (for all designated States except US): IMAGINA- 
TION TECHNOLOGIES LIMITED [GB/GB); Home Park 
Estate. Kings Langley, Hertfordshire WD4 SL2 (GB). 

(7?,) Inventors; and ' 

(75) Jtavemors/Appiic^nts (for US only): CAREY, Michael. John 
IGB/GBJ; Enstgma Limited, Turing House, Station Road. 
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(54) Tide; CANCELLATION OF NON-STATIONARY INTERFERING SIGNALS FOR SPEECH RECOGNITION 
(57) Abstract 



System for cancellation of 
non-stationary interfering signals, 
particularly for use for mitigating 
effects of such interferers produced 
by in-car entertainment (EGAD) 
devices . for speech recognition 
applications. The system spectrally 
analyses signals output by the ECAD 
before and after they are passed 
through an tn-car acoustic channel. 
A model of the acoustic channel 
Is built by the system's algorithm. 
For speech recognition the model is 
spectrally subtracted from a signal 
received ai a microphone in order to 
recover a wanted speech signal. The 
acoustic channel model is built by 
estimating frequency domain acoustic 
transfer functions between each 
loudspeaker used by the ECAD and 
the microphone. 
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I. Basis of the report 

l . With regard to the elements of the international application (Replacement sheets which have been furnished to 
the receiving Office in response to an invitation under Article 14 are referred to in this report as Originally filed" 
and are not annexed to this report since they do not contain amendments (Rules mi 6 and 70. 1 7)): 

„ Description, pages: 

1-29 as originally filed 



Claims, No-: 

1-31 as originally filed 

Drawings, sheets: 

1/8-8/8 as originally filed 



2. With regard to the language, ail the elements marked above were available or furnished to this Authority in the 
language in which the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language: , which is: 

□ the language of a translation furnished for the purposes of the international search (under Rule 23.1(b)). 

□ the language of publication of the international application (under Rule 48.3(b)). 

□ the language of a translation furnished for the purposes of international preliminary examination (under Rule 
55.2 and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the 
international preliminary examination was carried out on the basis of the sequence listing: 

□ contained in the international application in written form. 

□ filed together with the international application in computer readable form. 

□ furnished subsequently to this Authority in written form. 

□ furnished subsequently to this Authority in computer readable form. 

□ The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in 
the international application as filed has been furnished. 

□ The statement that the information recorded in computer readable form is identical to the written sequence 
listing has been furnished. 

4. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 
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□ the drawings, sheets: 

5. □ This report has been established as if (some of) the amendments had not been made, sincfe they have been 
considered to go beyond the disclosure as filed (Rule 70.2(c)): 

(Any replacement sheet containing such amendments must be referred to under item 1 and annexed to this 
report.) 

6- Additional observations, if necessary: 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1. Statement 

Novelty (N) Yes: Claims 1-31 

No: Claims 

Inventive step (IS) Yes: Claims 2-1 7;1 9-29 

No: Claims 1,18,30-31 

Industrial applicability (IA) Yes: Claims 1-31 

No: Claims 



2. Citations and explanations 
see separate sheet 



VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 
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To Section V: 

1 . Claim 1 does not meet the requirement of Article 33(3) PCT for the following 
reason: 

Maintaining performance in the presence of interfering signals is a well known 
problem associated with speech recognizers. In the prior art, adaptive filters are 
known to tackle the above problem. 

Document D1= US-A-4630304 (introduced by the International Preliminary 
Examining Authority; a copy is enclosed), for example, discloses an apparatus for 
cancellation of quasi-stationary interfering signals whereby said apparatus 
includes (see col. 3, 1. 36-61; fig. 1): 

- means for receiving an acoustic signal; 

- means for generating an estimated value of a magnitudes spectrum of said 
quasi-stationary interfering signals (see col. 3, 53-57); and 

- means for subtracting said estimated value from said received acoustic signal to; 
produce a representation of a wanted speech magnitudes spectrum (see col. 3, L 
58-61). 

In an attempt to overcome the problem of non-stationary interfering signals, it 
would readily occur to a skilled person to employ the above apparatus for 
cancellation of interfering signals. As a result, the subject-matter of claim 1 would 
be obvious to the skilled person and, hence, claim 1 does not involve an inventive 
step. 

2. Claim 18 claims a method of cancellation of one or more non-stationary interfering 
signals for speech recognition. Since method claim 18 corresponds to apparatus 
claim 1 , the objection of lack of inventive step raised against claim 1 applies to 
claim 1 8 as well. Moreover, claims 30-31 as far as dependent upon claim 1 are 
not inventive. 

3. Claims 2-17 and 19-29 are new and appear to involve an inventive step. 
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To Section VII: 

4. Document D1 discloses background art which is not identified in the description; 
furthermore, the relevant prior art disclosed therein is not discussed (Rule 
5.1(a)(ii) PCT). 
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(54) Noise canceler 



(57) A noise canceler of the present invention 
includes a signal-to-noise power ratio estimator to 
which a main signal and a reference signal are input 
The estimator io estimates the sinai-to-noise power 
ratio of the main signal from the mean power of a 
desired signal contained in the main siganl and a mean 
power of a noise signal also contained in the main sig- 
nal. In addition, the estimator estimates the signal-to- 
noise power ratio of the reference signal from the mean 
power of a desired signal contained in the reference sig- 
nal and the mean power of a noise singal also contained 
in the reference signal. An adptrve filter for estimating 
me noise signal of the main signal has its step size for 
coefficient updating controlled in accordance with the 
estimated signal-to-noise power ratio of the noise sig- 
nal. On the other hand, an adptive filter for estimating 
the desired signal of the reference signal has its step 
si2e for coefficient updating controlled in accordance 
with the estimated signal-to-noise power ratio of the ref- 
erence signal. Oelay circuits are provided for compen- 
sating for a delay ascribable to a power averaging 
procedure which a signal -to-nolse power ratio estimator 
executes to calculate the estimated siganl-to-noise 
power ratios. 
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Description 

The present invention relates to a noise canceler and, more particularly, to a noise canceler for canceling, by use 
of an adaptive fitter, a background noise signal introduced into a speech signal input via a microphone, a handset or the 
5 like. 

A background noise signal introduced into a speech signal input via, e g., a microphone or a handset is a critical 
problem when it comes to a narrow band speech coder, speech recognition device and so forth which compress infor- 
mation to a high degree. Noise cancelers for canceling such acoustically superposed noise components include a biin- 
put noise canceler using an adaptive filter and taught in a Widrow et al. "Adaptive Noise Cancelling: Principles and 
10 Applications", PROCEEDINGS OF IEEE, VOL 63; NO. 12, DECEMBER 1975, pp. 1692-1716 (Document 1 hereinaf- 
ter). 

The noise canceler taught in Document 1 includes an adaptive filter for approximating the impulse response of a 
noise path along which a noise signal input to a microphone assigned to a reference signal (reference signal micro- 
phone hereinafter) to propagate toward a microphone assigned to a main signal (main signal microphone hereinafter). 
is The adaptive filter is capable estimating noise introduced into the main signal microphone. The estimated noise signal 
is subtracted from a main signal (combination of a desired signal and a noise signal) input to the main signal micro- 
phone. 

The filter coefficient of the above adaptive titer is corrected by determining a correlation between an error signal 
produced by subtracting the estimated noise signal from the main signal and a reference signal derived from the refer- 
20 ence signal microphone. Typical of an algorithm for such coefficient correction, i.e., a convergence algorithm is "LMS 
algorithm" describe in Document 1 or "LIM (Learning Identification Method) algorithm" described in IEEE TRANSAC- 
TIONS ON AUTOMATIC CONTROL, VOL 12, NO. 3, 1967, pp. 282-287. 

A conventional noise cancellation principle will be described with reference to FIG. 5. As shown, a noise canceler 
includes a main signal microphone 1 , a reference signal microphone 2, an adaptive f Oter 3, a subtracter 4, and an output 
25 terminal 5. A desired signal S(z) spoken by a speaker (signal source) is input to the main signal microphone 1 adjoining 
the speaker's mouth by way of a path having an acoustic transfer characteristic HA(z); z is expressed as: 

z = exp(2*j/FS) _ Eq.(1) 

30 where FG denotes a sampling frequency. 

On the other hand, noise N(z) issuing from a noise source is input to the main signal microphone 1 via a path hav- 
ing an acoustic transfer, characteristic GA(z). At the same time r the noise N(z> is input to a reference signal microphone 
2 remote from the speaker by way of a path having an acoustic transfer characteristic GB(z). The adaptive filter 3 esti- 
mates, based on the main signal XA(z) and reference signal XB(z), the acoustic transfer characteristic (noise path) P(z) 
35 of an acoustic path along which noise output from the noise source N(z) and then input to the reference signal micro- 
phone 2 will propagate to the main signal microphone 1 when the desired signal S(z) is not input 
The acoustic transfer characteristic P(z) to be estimated is produced by: 

P(z)oGA(z)/GB(z) Eq.(2) 

40 

The adaptive filter 3 therefore constitutes a filter having a transfer characteristic W1 (z) identical with the transfer func- 
tion P(z) and operates to generate an estimated noise signal F1 (z) identical with the noise signal contained in the main 
signal. The subtracter 4 subtracts the estimated noise signal F1(z) output from the filter 3 from the main signal XA(z), 
thereby producing an output E1(z). When the desired signal S(z) is not input the output signal E1(z) is expressed as: 

45 




Eq.(3) 



50 

In this manner, the adaptive filter 3 is capable of estimating the acoustic transfer characteristic P(z) by updating the 
coefficient such that the output signal E1(z) is zero when the desired signal S(z) is not contained. The output signal 
E1(z) is referred to as an error signal because it is representative of an error in the learning operation of the adaptive 
55 filter. 

After the convergence of the adaptive fitter 3, the output signal El (z) is expressed as: 



2 
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= XAte)-Wl(z)XB(z) 
= HA(2)$(z)[1 -{HB(z)/HA(2)}Wl(2)] 
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As the Eq.(4) indicates, the output signal Ei(z) does not contain any noise signal N(z). i.e., noise has been can- 
celed. However, the problem is that when the reference signal microphone 2 contains the desired signal component 
S(z), i.e.. when the acoustic transfer characteristic HB(2) from the desired signal S(z) to the reference signal micro- 
phone 2 rs not zero, a signal distortion represented by [ 1 - {HB(2)/HA(2)}W1 (z) J occurs. 
- To solve the above problem, an adaptive filter fbrcorrecting the signal distortion contained in the output signal Si (z) 
may be added, as taught rn Japanese Patent Uid-Open Publication Na 8-561 80. FIG. 6 shows a noise canceler includ- 
ing such an additional adaptive filter. As shown, the noise canceler has an adaptive filter 6 for the above correction and 
a subtracter 7 m addition to the structural elements shown in FK3. 5. When the main signal XA(z) contains the desired 
signal S(z) and if noise is absent is of less than certain level, the adaptive filter 6 performs learning such that the output 
E2(x) of the subtracter 7 decreases. Assuming that the adaptive filter 6 has a transfer characteristic W2(z) then the filter 
6 performs the above learning based on, e.g., the UM scheme such that when N(z) is zero or negligible. E2(2) has the 
following value: 



; W2(z)S(z)HB(z)Wl(z) - HA(z) + HA(z)S{z) 



25 



45 



SC 
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Therefore, the transfer characteristic W2(z) of the adaptive filter 6 is produced by: 

The output F2(z) of the adaptive filter 6 derived from the learning is expressed as: 

Z^ z ^^^ ZmHZ)]i HA(2)S(2>t1 ' HB(z)/HA(z)}Wl(z)] **' {7) 

As a result, a desired signal HA(z)S(z) free from signal distortion is output. 

As stated above, the conventional noise canceler updates the coefficient of the adaptive filter 3 and learns the 
acoustic characteristic of noise in sections where the noise signal N(z) is present and the desired signal component 
S(z) is absent or negligibly small. Further, the noise canceler updates the coefficient of the adaptive filter 4 and learns 
a signal distortion correction filter in sections where the desired signal component S(z) is present and the noise com- 
ponent N(z) is absent or negligibly small. It is therefore necessary to detect the above sections where the desired signal 
component S(z) is absent (or little) and the sections where the noise signal component N(z) is absent (or little) and to 
comrnand the adaptive filters to perform leaning in such sections from the outside. 

However, it is, in many cases, difficult to command the adaptive filters to perform learning from the outside in 
accordance with the level of the desired signal and that of the noise signal, depending on the situation in which the 
nose canceler is located. With the conventional noise canceler, a sufficient noise canceling ability and a sufficient dis- 
tortion correction characteristic are not achievable unless adequate learning sections are indicated to each adaptive fil- 
ter for the learning purpose. 

It is therefore an object of the present invention to provide a noise canceler capable of achieving a sufficient noise 
canceling ability and reducing signal distortion even when adequate learning sections cannot be indicated from the out- 
side. 

A noise canceler of the present invention includes a first delay circuit for delaying a main signal containing a desired 
signal and a noise signal by a preselected period of time to thereby output a delayed main signal. A second delay circuit 
receives the noise signal as a reference signal and delaying it by the preselected period of time to thereby output a 
delayed reference signal. A first subtracter subtracts a first estimated noise signal from the delayed main signal to 
thereby generate a first desired signal output. A second subtracter subtracts a first estimated desired signal from the 
delayed reference signal to thereby generate a first noise signal output. A first adaptive filter receives the first noise sig- 
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nal output and adaptively estimates a noise signal contained In the delayed main signal to thereby output the first esti- 
mated noise signal. A second adaptive fitter receives the first desired signal output and adaptively estimating a desired 
signal contained in the delayed reference singal to thereby output the first estimated desired signal. A signaMo-noise 
power ratio estimator receives the main signal and reference signal and calculates desired signal power and noise sig- 

s nal power of the main signal and desired signal power and noise signal power of the reference signal to thereby output 
an estimated value of a power ratio of the main signal to the noise signal and an estimated value of a power ratio of the 
reference signal to the noise signal. A step size output circuit receives the estimated values from the signal-to-noise 
power ratio estimator to thereby output a first and a second step size representative of an amount of correction of a filter 
coefficient of the first adaptive filter and an amount of correction of a filter coefficient of the second adaptive filter, 

io respectively. 

; — The above and other objects, features and advantages of the present .invention wifl become apparent from the fol- 
lowing detailed description taken with the accompanying drawings in which: 

FIG. 1 is a block diagram schematically showing a noise canceler embodying the present invention: 
is FIG. 2 is a block diagram schematically showing a signai-to-noise power ratio estimator included in the embodi- 
ment; 

FIGS. 3 and 4 are flowcharts demonstrating the operation of a step size output circuit 11 also included in the 
embodiment: 

FIG. 5 shows the principle of a conventional noise canceler; and 
™ FIG. 6 is a block diagram schematically showing a specific configuration of a conventional noise canceler. 

Referring to FIG. 1 of the drawings, a noise canceler embodying the present invention is shown. As shown: the 
noise canceler includes a first microphone 1 for a main signal, a second microphone 2 for a reference signal, an output 
terminal 5, adaptive filters 3 and 6 t subtracters 4 and 7. delay circuits 8 and 9. a signal-to-noise power ratio estimator 
10, and a step size output circuit 1 1 . The operation of the adaptive filters 3 and 6 win be described first 

A main signal XA(z) is delayed by the delay circuit 8 by D samples to turn out a delayed main signal XA(z)Z 0 where 
Z~° denotes a delay by D samples. The signal XA(z)Z"° is applied to the subtracter 4, On the other hand, a reference 
signal XB(z) is delayed by the delay circuit 9 by D samples to turn out a delayed reference signal XB(2)Zr 0 "and then 
applied to the subtracter 7. The delay by D samples condensates for a delay ascribabie to the calculation of a signal- 
3c to-noise power ratio to be effected by the signal-to-noise power estimator 10, as will be described later specifically. 
- Because the delays provided at the main signal side of the adaptive.f ifter 3 and the reference signal side of the adaptive 
filter 6, respectively, are equal, they have no influence on the relation between the main signal and the reference signal. 
Therefore, let 0 be assumed to be zero hereinafter. 

The adaptive filter 3 operates to estimate a noise signal included In the main signal XA(z) while the adaptive filter 
05 5 operates to estimate a desired signal included in the reference signal XB(z). To allow the filter 3 to estimate the noise 
. rJgnal. the desired signal estimated by the filter 6 is subtracted from the reference signal by the subtracter 7, and the 
resuming noise signal is input to the filter 3. Likewise, the noise signal estimated by the filter 3 Is subtracted from the 
train signal, and the resulting desired signal is input to the filter 6. For this purpose, the two filters 3 and 6 are cross- 
coupled, as illustrated. 

w Assume that the subtracters 4 and 7 produce output signals El (z) and E2(2), respectively, that the adaptive filter 3 
has a transfer characteristic Wi(z) and produces an output Fi(z), and that the adaptive filter 6 has a transfer charac- * 
t eristic W2(z) and produces an output F2(z). Then, £1 (z) and E2(z) are expressed as: 



El(z)*XA(z)-F1fz} Eq.(8) 
45 =XA(z)-Wl(z)E2(z) 

RS&SfcEiS Eq<9 ' 

By using the desired signal S(z). noise N(z) and acoustic transfer characteristics HA(z), HB{z) and GB(z) descrtoed 
with reference to FIG. 5. the main signal XA(z) and reference signal XB(z) are produced by: 

so 

XA(z) = GA(z)N(z) + HA(z)S(2) Eq,( 1 0) 

X8(z) = GB(z)N(z) + H8(z)S(z) Eq.( 11 ) 
ss The above equations give Ei(z) and £2(z) < as follows: 

Hl(z) = {1/{1 - Wl(z)W2(z)}] (HA(z) - W1(z)HB(z)}S(z) + [1/{1 - W1(z)W2(z)}J {GA(z) - Wl(z)GB(z)}N(z) Eq.(12) 
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E2(z) - - W1(z)W2(z)}] {HB(z) - W1(z)HA(z)}S(z) + [1/(1 - W1 (z)W2(z)}J {GB(z) - W1(z)OA<z)}N(z) Eq.(i 3 ) 
Therefore, if the following equations are satisfied; 

s W1(z) = GA(z)/GB(z) Eq.(14) 

W2(z) * HB(z)/HA(z) Eq.(15) 

then, there hold; 

w 

H1<z)«S(z) : . Eq.(l6) 

E2(*) = N(z) Eq.(l7) 

is As a result, the output E1(z) of the subtracter 4 Is the desired signaJ from which noise has been cancelled. 

Now, for the adaptive filter 3 to estimate a noise signal contained in the main signaJ accurately, it is necessary to 
increase the amount erf updating of the filter coefficient when the desired signal of the main signal obstructing the esti- 
mation is smaJler rhan the noise signaJ to be estimated. Conversely, when the desired signal of the main signal is 
greater than the noise signal, it is necessary to reduce the above amount because the signal obstructing the estimation 
20 is greater than the noise signal. 

On the other hand, for the adaptive filter $ to estimate the desired signal of the reference signal accurately, it is nec- 
essary to increase the amount of updating of the filter coefficient when the noise signal contained in the reference signal 
obstructing the estimation is smaller than the desired signal. Conversely, when the noise signal of the reference signal 
is greater than the desired signal, it is necessary to reduce the above amount because the signal obstructing the esti- 
ss mation is greater than the desired signal. 

The coefficient of each adaptive filter can be controlled to meet the above requirement if the step size of the learn- 
ing algorithm of the fitter is controlled, as follows. 

A_method of updating the coefficient will be described , assuming the LIM scheme as a learning algorithm and the 
adaptive filter 3 by way of example. Assume that the main signal XA(z)is denoted by xa(k) in time domain, that E2(z) 
30 input to the filter 3 is denoted by e2(k) in time domain, that Fi(z) output from the filter 3 is denoted by fi(k) in time 
domain, and that Et(z) output from the subtracter 4 is denoted by el(k) in time domain; k is an index representative of 
time. - 

Assuming that the j-th coefficient of the filter 3 at a time k is wlj(k). then an estimated noise signal f 1 (k) output from 
the filter 3 is expressed as: 



35 



40 



f1(k) = £ o»lj(k) • e2(k-D Eq.(18) 
i-o 

where N denotes the number of taps of the f iiter 3. 

A coefficient wlj(k+i) at a time (k+1 ) is produced on the basis of an error signal el(k) determined by the subtracter 4: 

, *ij(k) + ^W^H^^l) Eq . (19) 
S e2(k-m) 2 

m-0 



where ji1 (k) is the step size for updating the coefficient of the f Hter 3. 

so A greater step size *tl(k) promotes rapid convergence because the coefficient is corrected by a greater amount. 
However, when components obstructing the updating of the coefficient are present, the greater amount of updating is 
noticeably influenced by such components and increases the residual error. Conversely, a smaller stepwise jii(k) 
reduces the influence of the above obstructing components and therefore the residual error although ft increases the 
converging time. It follows that a trade-off exists between the "converging time" and the "residual error in the setting of 

55 the step size. 

likewise, as for the filter 6. assume that the reference signal XB(z)i$ denoted by xb(k) in time domain, that E1(z) J 
input to the filter 6 is denoted by el (k) in time domai^ that F2(z) output from the filter 6 is denoted by f2(k) in time f 
domain, and that E2(z) output from the subtracter 7 is denoted by e2(k) in time domain. Then, an estimated noise signal / 
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f2(k) output from the filter 6 is expressed as: 

f2(k)=£ • Eq>(20) 

A coefficient w2j(k+l) at the time (k+1) is produced on the basis of an error signal e2(k) determined by the sub- 
tracter 7: 

2 el(k-m) 2 

75 where p2(k) is the step size for updating the coefficient of the filter 6. 

As stated above, the coefficient can be variably controlled by controlling the step size of the adaptive filter 
The operation of the signal -to-noise power ratio estimator 10 will be described hereinafter. As shown in PIG. 2, the 
estimator 10 is made up of adaptive filters 12 and 13, subtracters 14 and 15, power mean circuits 16, 17. 18 and 19, 
and dividers 20 and 21 . The adaptive filters 12 and 13 and subtracters 14 and IS are cross-coupled in exactly the same 

.?o manner as in FIG. 1 . The difference is that step sizes u3 and y4 assigned to the adaptive filters 1 2 and 13, respectively, 
each is fixed and great enough to promote convergence. For example, when the LIM scheme is used, the step sizes u3 
and *i4 are selected to be between about 0.2 and about 0.5. Such relatively great step sizes promote rapid convergence 
although they will increase the residual error. 

Assume that the adaptive filters 12 and 13 both are converged. Then, the Wter 12 produces an output f3(k) which 

25 is the noise signal contained in the main signal. The subtracter 14 produces an output e3(k) which is the desired signal 
also contained in the main signal. The power mean circuit 16 squares the output e3(k) of the subtracter 14 so as to 
determine its time mean and thereby outputs desired signal power PSA(k) particular to the main signal. The power 
mean circuit 1 7 squares the output f3(k) of the filter 1 2 so as to determine its time mean and thereby outputs noise sig- 
nal power PNA(k) particular to the main signal. 

30 The other filter 1 3 produces an output f4<k) which is the desired signal contained in the reference signal. The sub- 
tracter 15 produces an output e4<k) which is the noise signal also contained in the reference signal. The. power mean 
circuit 19 squares the output e4(k) of the subtracter 15 so as to determine its time mean and thereby outputs noise sig- 
nal power PNB(k) particular to the reference signal. Likewise, the power mean circuit squares the output f4(k) of the fil- 
ter 13 so as to determine its time mean and thereby outputs desired signal power PSB(k) particular to the reference 

35 signal. 

The divider 20 divides the desired signal power PSA(k) output from the power mean circuit 16 by the noise signal 
power PNA(K) output from the power mean circuit 1 7. As a result, an estimated signal-to-noise power ratio SNRA(k) of 
the main signal is output from the aWtdec 20. Likewise, the divider 21 divides the desired signal power PSB(K)output 
from the power mean circuit 18 by the noise signal power pnb(K) output from the power mean circuit 19. As a result, an 

*o estimated signal-to-noise power ratio SNRB(k) of the reference signal is output from the divider 21 : 

When the averaging operation of the power mean circuits 10-19 is implemented by, e.g.. the method of moving 
average, the calculated power mean values involve a delay of AAV dependent on the number of times of averaging with 
respect to the actual power variation. The illustrative embodiment includes the delay circuits 8 and 9. FIG. 1 , in order to 
compensate tor the above delay AAV. It is therefore desirable that the delay Z° of the delay circuits 8 and 9 be equal to 

45 <\AV 

With the above configuration, the signal-to-noise power ratio estimator 10 implements rapid convergence by pro- 
viding the cross-coupled adaptive filters 12 and 13 with a relatively great step size. The estimator 10 outputs, by use of 
the converged signals, the estimated signal-to-noise power ratio SNRA(k) of the main signal and the estimated signal- 
to-noise power ratio SNRB(k) of the reference signal. 
sc Reference will be made to FIGS. 3 and 4 for describing the operation of the step size output circuit 1 1 . Rrst the 
estimated SNiRA(k> of the main signal output from the signal-to-noise power ratio estimator .10 is input to a monotone 
decreasing function (step 31). Assuming that f( ) is the monotone decreasing function for SNRA (k), then the output 
OUTi (k) of the function is produced by (step 32) : 

55 OUTl(k) =f(SNRA(k)) Eq.(22) 

By use of the above value OUTI (k), the step size pl(k) of the adaptive fflter 3 is calculated as: 
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^l(k) a clip(OUT1(k). Mlmax, ulmin] Eq.(23) 
where ciip[a, b, c] rs a function for setting the maximum value and minimum value and defined as: 

ctipta, b» c] a a(c $ a * b) 
dipfa. b, c] = b (a> b) 

dipta. b. c] = c(a < c) Eq.(24) 

-i Limiting the step size by use of the maximum value jilmax and minimum value ulmin is desirable for the stable oper- 
ation of the adaptive filter. As for the adaptive filter 3. the function value determined by inputting the estimated signal- 
to-noise power ratio SNRA(k) to the monotone decreasing function is used as a step size, as stated above. It follows 
that the step size is reduced when the stgnal-to-noise power ratio is great or it is increased when the ratio is small 
75 (steps 33-36). 

The estimated signai-to-norse power ratio of the reference signal is also input to a monotone increasing function 
(step 41 ), Assuming that g( ) is the monotone decreasing function for SNRB (k), then the output OUT2(k) of the function 
is produced by (step 42) : 

& OUT2(k) = g(SNR 8<k)) Eq,(25) 
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By use of the above value OUT2(k). the step size *i2(k) of the adaptive filter 6 is calculated as: 

u2(k) * cliptOUT2(k), n2max. n2rrrinj Eq.(26) 

25 

As for the adaptive filter 6, the function value determined by inputting the estimated signal-to-noise power ratio 
SNRB(k) to the monotone decreasing function is used as a step size, as stated above. It follows that the step size Is 
increased when the signai-to-noise power ratio is great, or it is decreased when the ratio is small (steps 43-46). 

As described above, the step size output circuit 1 1 controls the step size to be fed to the adaptive filter 3 in accord- 
so ance with the estimated signal -to-noise power ratio SNRA(k) of the main signal. Also, the circuit 1 1 controls the step 
size to be fed to the adaptive filter 6 in accordance with the estimated signal-to-noise power ratio SNRB(k) of the refer- 
ence signal. 

Alternatively, an arrangement may be made such that the step sizes jil (k) and p2(k) assigned to the adaptive filters 
3 and 6. respectively, are compared, and smaller one of them is set to be zero in order to interrupt the learning function 

35 of the titer whose step size is determined to be zero. This kind of control successfully reduces interference between the 
two filters 3 and 6 and thereby promotes more accurate learning. 

In summary, it will be seen that the present invention provides a noise cancel er capable of estimating the noise sig- 
nal of a main signal and the noise signal of a reference signal accurately. The noise canceler therefore insures rapid 
convergence and allows a minimum of signal distortion to occur without resorting to a command customarily input from 

4C the outside for commanding the learning operation of filters. These advantages are derived from a unique configuration 
;n which a relation in si2e beiween a desired signal, which is an interference signal for an adaptive filter used to estimate 
:he noise signal of the main signal from the estimated signal-to-noise power ratio of the main signal, and the noise sig- 
nal to be canceled is determined. This relation is used to control a step size to be fed to the adaptive filter. This rs also- 
Tue with an adaptive filter for estimating the desired signal of the reference signal from the estimated signal-to-noise 

4S power ratio of the reference signal: the noise signal is an interference signal while the desired signal is a signal to be 
canceled 

Various modifications will become possible for those skilled in the art after receiving the teachings of the present 
disclosure without departing from the scope thereof. 



sc Claims 



1 . A noise canceler comprising: 

first delaying means for delaying a main signal containing a desired signal and a noise signal by a preselected 
55 period of time to thereby output a delayed main signal; 

second delaying means for receiving the noise signal as a reference signal and delaying the reference singal 
by the preselected period of time to thereby output a delayed reference signal; 

first subtracting means for subtracting a first estimated noise signal from said delayed main signal to thereby 
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generate a first desired signal output: 
second subtracting means for subtracting a first estimated desired signal from said delayed reference signal to 
thereby generate a first noise signal output: 

a first adaptive filter for receiving said first noise signal output and adaptively estimating a noise signal con- 
5 tained in said delayed main signal to thereby output said first estimated noise signal; 

a second adaptive filter for receiving said first desired signal output and adaptively estimating a desired signal 
contained in said delayed reference singaJ to thereby output said first estimated desired signal: 
signaMo-noise power ratio estimating means for receiving said main signal and said reference signal and cal- 
culating desired signal power and noise signal power of the main signal and desired signaJ power and noise 
w signal power of the reference signal to thereby output an estimated value of a power ratio of the main signal to 

the noise signal and an estimated value of a power ratio of the reference signal to the noise signal; and 
~ step size outputting means for receiving said estimated values from said signaMo-noise power ratio estimating 
means to thereby output a first and a second step size representative of an amount of correction of a filter coef- 
ficient of said first adaptive filter and an amount of correction of a filter coefficient of said second adaptive filter, 
15 respectively. 

2. A noise canceler as daimed in claim 1 . wherein said signal-to-noise power ratio estimating means comprises: 

third subtracting means for subtracting a second estimated noise signal from the main signal to thereby gener- 
ate a second desired signal output: 

fourth subtracting means for subtracting a second estimated desired signal from the reference signal to thereby 
generate a second noise signal output; 

a third adaptive filter for receiving said second noise signal output and adaptivery estimating a noise signal con- 
tained in the main signal to thereby output said second estimated noise signal: 

a fourth adaptive filter for receiving said second desired signal output and adaptively estimating a desired sig- 
nal contained in the reference signal to thereby output a second estimated desired signal; 
first power averaging means for receiving said second desired signal output and producing a square mean of 
said second desired signal outputto thereby output desired signal power of the main signal; 
second power averaging means for receiving said second estimated noise signal and producing a square 
mean of said second estimated noise signal to thereby output noise signal power of the main signal; 
third power averaging means for receiving said second estimated desired signal and producing a square mean 
of said second estimated desired signal to thereby output desired signal power of the reference/ signal; 
fourth power averaging means for receiving said second noise Signal Output and producing a square mean of 
said second noise signal to thereby output noise signal power of the reference signal: 

first dividing means for dividing said desired signal power of the main signal by said noise signa power of the 
main signal to thereby output an estimated value of a power ratio of the main signal to the noise signla; and 
second dividing means for dividing said desired signal power of the reference signal by said noise signal power 
of the reference signal to thereby output an estimated value of a power ratio of the reference signal to the noise 
signal- 

A noise canceler as claimed in claim 1 or 2, wherein said step size outputting means comprises: 

means for inputting said estimated value of the power ratio of the main signal to the noise signal to a prese- 
lected monotonously increasing function to thereby calculate a first function value: and 
45 means for outputting as said first step size said first function value when said first function value is between a 

first maximum value and a first minimum value, or outputting said first maximum value when said first function, 
value is greater than said first maximum value, or outputting said first minimum value when said first function 
value is smaller than said first 

so minimum value. 

4. A noise canceler as claimed in claim 1 . 2 or 3. wherein said step size outputting means comprises: 

means for inputting said estimated value of the power ratio of the reference signal to the noise signal to a 
55 preselected monotonously increasing function to thereby calculate a second function value; and 

means for outputting as said second step size said second function value when said second function value is 
between a second maximum value and a second minimum value, or outputting said second maximum value 
when said second function value is greater than said second maximum value, or outputting said second mini- 
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mum value when said second function value is smaller than said second minimum value 

5. A noise canceler as claimed in claim 1 or 2. wherein said step size outputting means comprises: 

means for inputting said estimated value of the power ratio of th8 main signal to the noise signal to a prese- 
lected monotonously increasing function to thereby calculate a first function value: 

means for outputting as said first step size said first function value when said first function value is between a 
first maximum value and a first minimum value, or outputting said first maximum value when said first function 
value Is greater than said first maximum value, or outputting said first minimum value when said first function 
value rs smaller than said first minimum value: 
-2 means for inputting said estimated value of the power ratio-of the reference signal to the noise signal to a 

~ preselected monotonously increasing function to thereby calculate a second function value; and 

means for outputting as said second step size said second function value when said second function value is 
between a second maximum value and a second minimum value, or outputting said second maximum value 
when said second function value is greater than said second maximum value, or outputting said second mini- 
mum value when said second function value is smaller than said second minimum value; 

wherein one of said first and second step sizes smaller than the other is set to be zero. 

6. A noise canceler as claimed in daim 1 . a 3. 4 or 5. wherein the preselected period of time assigned to said first 
and second delaying means is equal to a delay ascrtbable to calculation of said estimated value of the power ratio 
of the main signal to the noise signal and said estimated value of the power ratio of the reference signal to the noise 
signal executed by said signal-to-noise power ratio estimating means. 
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Fig.3 
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